[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:09 dist-test-slave-0kls krb5kdc[11246](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:09 dist-test-slave-0kls krb5kdc[11246](info): set up 2 sockets
Aug 10 04:11:09 dist-test-slave-0kls krb5kdc[11246](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 04:11:10.096716 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.005s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:10.204309 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:34283
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:34283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:10.280454 11259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:10.280639 11259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:10.280660 11259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:10.281690 11259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:10.281728 11259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:10.281742 11259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:10.281755 11259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:10.281767 11259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:10.283154 11259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:34283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:34283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:10.283326 11259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:10.283460 11259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:10.287912 11265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:10.287930 11268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:10.287940 11264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:10.288049 11259 server_base.cc:1034] running on GCE node
I20260810 04:11:10.288435 11259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:10.288657 11259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:10.289832 11259 hybrid_clock.cc:648] HybridClock initialized: now 1786335070289797 us; error 102 us; skew 500 ppm
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:10.292124 11259 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:10.292580 11259 webserver.cc:460] Webserver started at http://127.10.249.190:43875/ using document root <none> and password file <none>
I20260810 04:11:10.292739 11259 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:10.292774 11259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:10.292850 11259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:10.293711 11259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "eac45f1e24914125927619aa217abf20"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "452b50bb133781c28c0761e4465ffbc3"
server_key_iv: "4a3a347b6bbd169c27a02ba18318b347"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.294126 11259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "eac45f1e24914125927619aa217abf20"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "452b50bb133781c28c0761e4465ffbc3"
server_key_iv: "4a3a347b6bbd169c27a02ba18318b347"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.295292 11259 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:10.295856 11275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.296026 11259 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:10.296110 11259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "eac45f1e24914125927619aa217abf20"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "452b50bb133781c28c0761e4465ffbc3"
server_key_iv: "4a3a347b6bbd169c27a02ba18318b347"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.296175 11259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:10.306245 11259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:10.307895 11259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:10.308038 11259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:10.312263 11259 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:34283
I20260810 04:11:10.312291 11330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:34283 every 8 connection(s)
I20260810 04:11:10.312625 11259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:10.313501 11331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:10.315683 11331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20: Bootstrap starting.
I20260810 04:11:10.316275 11331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:10.316570 11331 log.cc:824] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:10.317260 11331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20: No bootstrap required, opened a new log
I20260810 04:11:10.318594 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 11259
I20260810 04:11:10.318706 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:10.319487 11238 external_mini_cluster.cc:1428] Setting key 6f017a91391dabe8a62d4bce6c75d1e9
I20260810 04:11:10.319372 11331 raft_consensus.cc:348] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac45f1e24914125927619aa217abf20" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34283 } }
I20260810 04:11:10.319538 11331 raft_consensus.cc:374] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:10.319574 11331 raft_consensus.cc:729] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac45f1e24914125927619aa217abf20, State: Initialized, Role: FOLLOWER
I20260810 04:11:10.319720 11331 consensus_queue.cc:260] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac45f1e24914125927619aa217abf20" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34283 } }
I20260810 04:11:10.319840 11331 raft_consensus.cc:388] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:10.319876 11331 raft_consensus.cc:482] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:10.319927 11331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:10.320554 11331 raft_consensus.cc:504] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac45f1e24914125927619aa217abf20" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34283 } }
I20260810 04:11:10.320735 11331 leader_election.cc:302] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eac45f1e24914125927619aa217abf20; no voters:
I20260810 04:11:10.320904 11331 leader_election.cc:288] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:10.321177 11331 sys_catalog.cc:564] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:10.322602 11338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:10.322918 11338 raft_consensus.cc:686] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [term 1 LEADER]: Becoming Leader. State: Replica: eac45f1e24914125927619aa217abf20, State: Running, Role: LEADER
I20260810 04:11:10.323025 11338 consensus_queue.cc:237] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac45f1e24914125927619aa217abf20" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34283 } }
I20260810 04:11:10.323387 11336 sys_catalog.cc:455] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eac45f1e24914125927619aa217abf20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac45f1e24914125927619aa217abf20" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34283 } } }
I20260810 04:11:10.323431 11350 sys_catalog.cc:455] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eac45f1e24914125927619aa217abf20. Latest consensus state: current_term: 1 leader_uuid: "eac45f1e24914125927619aa217abf20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac45f1e24914125927619aa217abf20" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34283 } } }
I20260810 04:11:10.323575 11350 sys_catalog.cc:458] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:10.323800 11336 sys_catalog.cc:458] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20 [sys.catalog]: This master's current role is: LEADER
W20260810 04:11:10.323871 11349 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:11:10.323922 11349 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:11:10.324167 11353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:10.324349 11353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:10.325770 11353 catalog_manager.cc:1347] Generated new cluster ID: ef37e080e8064dbe9b80d50cc8408184
I20260810 04:11:10.325883 11353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:10.337445 11335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.320743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52818 (local address 127.10.249.190:34283)
0810 04:11:10.320967 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:10.320977 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:10.321012 (+ 35us) server_negotiation.cc:407] Connection header received
0810 04:11:10.323525 (+ 2513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:10.323533 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:10.323618 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:10.323756 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:10.326019 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.327321 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.328780 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.329318 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.329434 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.333702 (+ 4268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:10.333707 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:10.333707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:10.333718 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:10.335623 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.336076 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.336079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.336079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.336177 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.336443 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.336444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.336444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.336721 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:10.336867 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:10.337126 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 04:11:10.337249 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":108,"threads_started":1}
I20260810 04:11:10.341691 11353 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:10.342208 11353 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:10.352051 11353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eac45f1e24914125927619aa217abf20: Generated new TSK 0
I20260810 04:11:10.352229 11353 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:10.380085 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34283
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:10.458593 11358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:10.458786 11358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:10.458809 11358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:10.459978 11358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:10.460021 11358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:10.460074 11358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:10.461519 11358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:10.461763 11358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:10.462021 11358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:10.466867 11364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:10.466907 11366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:10.467087 11363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:10.467093 11358 server_base.cc:1034] running on GCE node
I20260810 04:11:10.467338 11358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:10.467568 11358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:10.468739 11358 hybrid_clock.cc:648] HybridClock initialized: now 1786335070468723 us; error 27 us; skew 500 ppm
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:10.471251 11358 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:10.471704 11358 webserver.cc:460] Webserver started at http://127.10.249.129:45167/ using document root <none> and password file <none>
I20260810 04:11:10.471920 11358 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:10.471987 11358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:10.472131 11358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:10.473110 11358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "cd75357f49454d28b4c8313b9ea9e8e4"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "c84a185dc904528c098ad7be6ea61986"
server_key_iv: "a7654811e16c927b9834ff13cee1f7ff"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.473448 11358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "cd75357f49454d28b4c8313b9ea9e8e4"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "c84a185dc904528c098ad7be6ea61986"
server_key_iv: "a7654811e16c927b9834ff13cee1f7ff"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.474853 11358 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:11:10.475535 11373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.475703 11358 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.475802 11358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "cd75357f49454d28b4c8313b9ea9e8e4"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "c84a185dc904528c098ad7be6ea61986"
server_key_iv: "a7654811e16c927b9834ff13cee1f7ff"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.475868 11358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:10.487639 11358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:10.489586 11358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:10.489748 11358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:10.490051 11358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:10.490422 11358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:10.490468 11358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.490506 11358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:10.490530 11358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.496702 11358 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:46317
I20260810 04:11:10.496744 11492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:46317 every 8 connection(s)
I20260810 04:11:10.497061 11358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:10.505074 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 11358
I20260810 04:11:10.505182 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:10.505355 11238 external_mini_cluster.cc:1428] Setting key e2603277e32e78a623a0fd94448c33ac
I20260810 04:11:10.506223 11335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.497873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:33037 (local address 127.10.249.190:34283)
0810 04:11:10.497937 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:10.497939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:10.498149 (+ 210us) server_negotiation.cc:407] Connection header received
0810 04:11:10.498672 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:10.498673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:10.498689 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:10.498754 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:10.499884 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.500394 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.501329 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.501534 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.501587 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.503583 (+ 1996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:10.503584 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:10.503585 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:10.503591 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:10.504732 (+ 1141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.505105 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.505106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.505107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.505206 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.505444 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.505444 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.505445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.505599 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:10.505664 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:10.506045 (+ 381us) server_negotiation.cc:299] Negotiation successful
0810 04:11:10.506146 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:11:10.506487 11495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.497859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34283 (local address 127.10.249.129:33037)
0810 04:11:10.498013 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:10.498047 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:10.498569 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:10.498806 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:10.498809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:10.499560 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:10.499785 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:10.499790 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.500477 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.500478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:10.501253 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:10.501255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.501608 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.501609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:10.501714 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.502204 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:10.502212 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:10.503504 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:10.504799 (+ 1295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:10.504806 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:10.504808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:10.505018 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:10.505264 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:10.505265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:10.505265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:10.505368 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:10.505676 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:10.505684 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:10.505883 (+ 199us) client_negotiation.cc:769] Sending connection context
0810 04:11:10.506007 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 04:11:10.506225 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":93,"threads_started":1}
I20260810 04:11:10.506971 11493 heartbeater.cc:347] Connected to a master server at 127.10.249.190:34283
I20260810 04:11:10.507084 11493 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:10.507272 11493 heartbeater.cc:511] Master 127.10.249.190:34283 requested a full tablet report, sending...
I20260810 04:11:10.507778 11292 ts_manager.cc:194] Registered new tserver with Master: cd75357f49454d28b4c8313b9ea9e8e4 (127.10.249.129:46317)
I20260810 04:11:10.508401 11292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:33037
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:10.530498 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34283
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:10.609603 11498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:10.609800 11498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:10.609824 11498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:10.610950 11498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:10.610993 11498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:10.611019 11498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:10.612437 11498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:10.612608 11498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:10.612864 11498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:10.617442 11504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:10.617448 11503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:10.617476 11506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:10.617530 11498 server_base.cc:1034] running on GCE node
I20260810 04:11:10.617893 11498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:10.618108 11498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:10.619273 11498 hybrid_clock.cc:648] HybridClock initialized: now 1786335070619270 us; error 37 us; skew 500 ppm
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:10.621773 11498 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:10.622253 11498 webserver.cc:460] Webserver started at http://127.10.249.130:43477/ using document root <none> and password file <none>
I20260810 04:11:10.622531 11498 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:10.622613 11498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:10.622763 11498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:10.623728 11498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "001ff8e36fcd4c29a62d9bf2fa09f5b3"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "be7cf572b36f55326ccd9d373151cb0b"
server_key_iv: "1fa1b20dd73e2502a8d9fe6f522f431e"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.624100 11498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "001ff8e36fcd4c29a62d9bf2fa09f5b3"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "be7cf572b36f55326ccd9d373151cb0b"
server_key_iv: "1fa1b20dd73e2502a8d9fe6f522f431e"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.625299 11498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260810 04:11:10.626019 11514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.626190 11498 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.626289 11498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "001ff8e36fcd4c29a62d9bf2fa09f5b3"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "be7cf572b36f55326ccd9d373151cb0b"
server_key_iv: "1fa1b20dd73e2502a8d9fe6f522f431e"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.626367 11498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:10.650707 11498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:10.653103 11498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:10.653293 11498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:10.653537 11498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:10.653916 11498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:10.653970 11498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.654016 11498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:10.654042 11498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.660108 11498 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:33615
I20260810 04:11:10.660158 11631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:33615 every 8 connection(s)
I20260810 04:11:10.660494 11498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:11:10.665779 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 11498
I20260810 04:11:10.665935 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:10.666102 11238 external_mini_cluster.cc:1428] Setting key 9456df5899457f1846e7b71d1b7be121
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:10.669762 11335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.661245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:52985 (local address 127.10.249.190:34283)
0810 04:11:10.661293 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:10.661295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:10.661519 (+ 224us) server_negotiation.cc:407] Connection header received
0810 04:11:10.662113 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:10.662115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:10.662127 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:10.662193 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:10.663163 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.663677 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.664642 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.664835 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.664919 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.667057 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:10.667059 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:10.667059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:10.667067 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:10.668495 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.668900 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.668901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.668902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.668962 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.669174 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.669175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.669175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.669305 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:10.669368 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:10.669602 (+ 234us) server_negotiation.cc:299] Negotiation successful
0810 04:11:10.669696 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:11:10.669903 11634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.661200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34283 (local address 127.10.249.130:52985)
0810 04:11:10.661356 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:10.661429 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:10.662008 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:10.662272 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:10.662276 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:10.662866 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:10.663055 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:10.663059 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.663771 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.663772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:10.664551 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:10.664553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.664928 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.664929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:10.665051 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.665452 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:10.665459 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:10.666962 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:10.668590 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:10.668597 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:10.668599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:10.668831 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:10.669025 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:10.669026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:10.669026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:10.669113 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:10.669366 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:10.669370 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:10.669468 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 04:11:10.669541 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:11:10.669666 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
I20260810 04:11:10.670298 11632 heartbeater.cc:347] Connected to a master server at 127.10.249.190:34283
I20260810 04:11:10.670403 11632 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:10.670560 11632 heartbeater.cc:511] Master 127.10.249.190:34283 requested a full tablet report, sending...
I20260810 04:11:10.670894 11292 ts_manager.cc:194] Registered new tserver with Master: 001ff8e36fcd4c29a62d9bf2fa09f5b3 (127.10.249.130:33615)
I20260810 04:11:10.671314 11292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:52985
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:10.690651 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34283
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:10.768365 11637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:10.768522 11637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:10.768541 11637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:10.769477 11637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:10.769507 11637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:10.769531 11637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:10.770817 11637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:10.771000 11637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:10.771184 11637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:10.775902 11645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:10.775877 11643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:10.775889 11642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:10.776130 11637 server_base.cc:1034] running on GCE node
I20260810 04:11:10.776312 11637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:10.776530 11637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:10.777684 11637 hybrid_clock.cc:648] HybridClock initialized: now 1786335070777657 us; error 55 us; skew 500 ppm
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:10.780128 11637 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:10.780534 11637 webserver.cc:460] Webserver started at http://127.10.249.131:43267/ using document root <none> and password file <none>
I20260810 04:11:10.780777 11637 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:10.780846 11637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:10.780999 11637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:10.782059 11637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "9b3abe9a63094688b10908f4c9dce922"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "47b0a2260705dd52139e8584040a3514"
server_key_iv: "212124c0e2691efcd49df347ea25e81d"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.782421 11637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "9b3abe9a63094688b10908f4c9dce922"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "47b0a2260705dd52139e8584040a3514"
server_key_iv: "212124c0e2691efcd49df347ea25e81d"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.783692 11637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:10.784363 11652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.784560 11637 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:10.784662 11637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "9b3abe9a63094688b10908f4c9dce922"
format_stamp: "Formatted at 2026-08-10 04:11:10 on dist-test-slave-0kls"
server_key: "47b0a2260705dd52139e8584040a3514"
server_key_iv: "212124c0e2691efcd49df347ea25e81d"
server_key_version: "encryptionkey@0"
I20260810 04:11:10.784734 11637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:10.800467 11637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:10.802390 11637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:10.802553 11637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:10.802806 11637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:10.803128 11637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:10.803184 11637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.803218 11637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:10.803244 11637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:10.809198 11637 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:43883
I20260810 04:11:10.809258 11766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:43883 every 8 connection(s)
I20260810 04:11:10.809616 11637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:10.814961 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 11637
I20260810 04:11:10.815047 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:10.815243 11238 external_mini_cluster.cc:1428] Setting key 6d9a880c2d2ff77839b4afae2e201f3e
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:10.818835 11335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.810401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:34355 (local address 127.10.249.190:34283)
0810 04:11:10.810444 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:10.810446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:10.810667 (+ 221us) server_negotiation.cc:407] Connection header received
0810 04:11:10.811199 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:10.811200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:10.811214 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:10.811263 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:10.812221 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.812726 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.813724 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.814056 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.814138 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.816464 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:10.816465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:10.816466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:10.816473 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:10.817704 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.818123 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.818124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.818125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.818177 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.818382 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.818383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.818383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.818479 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:10.818536 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:10.818720 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 04:11:10.818776 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:11:10.819020 11770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.810372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34283 (local address 127.10.249.131:34355)
0810 04:11:10.810547 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:10.810580 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:10.811083 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:10.811330 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:10.811334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:10.811922 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:10.812111 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:10.812115 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.812817 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.812818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:10.813620 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:10.813623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.814144 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.814146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:10.814295 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.814726 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:10.814734 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:10.816382 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:10.817778 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:10.817821 (+ 43us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:10.817823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:10.818056 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:10.818244 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:10.818244 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:10.818245 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:10.818331 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:10.818528 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:10.818530 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:10.818629 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 04:11:10.818709 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:11:10.818820 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260810 04:11:10.819492 11767 heartbeater.cc:347] Connected to a master server at 127.10.249.190:34283
I20260810 04:11:10.819595 11767 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:10.819782 11767 heartbeater.cc:511] Master 127.10.249.190:34283 requested a full tablet report, sending...
I20260810 04:11:10.820178 11292 ts_manager.cc:194] Registered new tserver with Master: 9b3abe9a63094688b10908f4c9dce922 (127.10.249.131:43883)
I20260810 04:11:10.820554 11292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:34355
I20260810 04:11:10.827545 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:10.849958 11775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.842839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47358 (local address 127.10.249.129:46317)
0810 04:11:10.843014 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:10.843018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:10.843028 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:10.843051 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:10.843052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:10.843066 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:10.843132 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:10.843610 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.844279 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.844852 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.845110 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.845160 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.847347 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:10.847355 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:10.847357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:10.847369 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:10.848735 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.849094 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.849097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.849098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.849157 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.849353 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.849354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.849354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.849490 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:10.849685 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:10.849727 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 04:11:10.849836 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
W20260810 04:11:10.850271 11401 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47358
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:10.869920 11775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:10.863896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47372 (local address 127.10.249.129:46317)
0810 04:11:10.863964 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:10.863966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:10.863998 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:11:10.864035 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:10.864035 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:10.864044 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:10.864084 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:10.864523 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.864928 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.865594 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:10.865776 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:10.865885 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:10.867866 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:10.867868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:10.867868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:10.867874 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:10.869019 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.869319 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.869320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.869320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.869367 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:10.869522 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:10.869523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:10.869523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:10.869602 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:10.869692 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:10.869751 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 04:11:10.869862 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 04:11:10.870416 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 11358
I20260810 04:11:10.876384 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 11498
I20260810 04:11:10.881891 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 11637
I20260810 04:11:10.886579 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 11259
2026-08-10T04:11:10Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1819 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11783](info): set up 2 sockets
Aug 10 04:11:10 dist-test-slave-0kls krb5kdc[11783](info): commencing operation
krb5kdc: starting...
W20260810 04:11:11.883132 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.976s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:11 dist-test-slave-0kls krb5kdc[11783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:11.996276 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:46363
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:46363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:12.080914 11797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:12.081162 11797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:12.081197 11797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:12.082434 11797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:12.082499 11797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:12.082521 11797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:12.082543 11797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:12.082573 11797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:12.083972 11797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:46363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:46363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:12.084267 11797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:12.084496 11797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:12.089407 11802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:12.089397 11805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:12.089432 11797 server_base.cc:1034] running on GCE node
W20260810 04:11:12.089397 11803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:12.089860 11797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:12.090173 11797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:12.091320 11797 hybrid_clock.cc:648] HybridClock initialized: now 1786335072091299 us; error 39 us; skew 500 ppm
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:12.093709 11797 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:12.094136 11797 webserver.cc:460] Webserver started at http://127.10.249.190:46371/ using document root <none> and password file <none>
I20260810 04:11:12.094329 11797 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:12.094369 11797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:12.094453 11797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:12.095433 11797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "392c2f07490a478aa12523371b5334bd"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "46bed590e581a94f81365e03fa18e959"
server_key_iv: "fd82cc3ecc19b75606117a0d0ab549d0"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.095737 11797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "392c2f07490a478aa12523371b5334bd"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "46bed590e581a94f81365e03fa18e959"
server_key_iv: "fd82cc3ecc19b75606117a0d0ab549d0"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.096971 11797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:12.097626 11812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.097826 11797 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:12.097930 11797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "392c2f07490a478aa12523371b5334bd"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "46bed590e581a94f81365e03fa18e959"
server_key_iv: "fd82cc3ecc19b75606117a0d0ab549d0"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.097988 11797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:12.107597 11797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:12.109252 11797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:12.109352 11797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:12.113107 11797 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:46363
I20260810 04:11:12.113202 11866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:46363 every 8 connection(s)
I20260810 04:11:12.113507 11797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:12.114434 11867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:12.116562 11867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd: Bootstrap starting.
I20260810 04:11:12.117223 11867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:12.117480 11867 log.cc:824] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:12.118229 11867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd: No bootstrap required, opened a new log
I20260810 04:11:12.119711 11867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "392c2f07490a478aa12523371b5334bd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46363 } }
I20260810 04:11:12.119899 11867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:12.119958 11867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 392c2f07490a478aa12523371b5334bd, State: Initialized, Role: FOLLOWER
I20260810 04:11:12.120144 11867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "392c2f07490a478aa12523371b5334bd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46363 } }
I20260810 04:11:12.120249 11867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:12.120294 11867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:12.120343 11867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:12.120854 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 11797
I20260810 04:11:12.120949 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:12.120949 11867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "392c2f07490a478aa12523371b5334bd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46363 } }
I20260810 04:11:12.121073 11867 leader_election.cc:302] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 392c2f07490a478aa12523371b5334bd; no voters:
I20260810 04:11:12.121127 11238 external_mini_cluster.cc:1428] Setting key 6c94ffbacfab8365ab1c7429d032c373
I20260810 04:11:12.121249 11867 leader_election.cc:288] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:12.121269 11870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:12.121435 11870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [term 1 LEADER]: Becoming Leader. State: Replica: 392c2f07490a478aa12523371b5334bd, State: Running, Role: LEADER
I20260810 04:11:12.121549 11870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "392c2f07490a478aa12523371b5334bd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46363 } }
I20260810 04:11:12.121758 11867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:12.121961 11871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "392c2f07490a478aa12523371b5334bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "392c2f07490a478aa12523371b5334bd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46363 } } }
I20260810 04:11:12.122047 11871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:12.122085 11872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 392c2f07490a478aa12523371b5334bd. Latest consensus state: current_term: 1 leader_uuid: "392c2f07490a478aa12523371b5334bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "392c2f07490a478aa12523371b5334bd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46363 } } }
I20260810 04:11:12.122148 11872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:12.122260 11876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:12.122829 11876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:12.124246 11876 catalog_manager.cc:1347] Generated new cluster ID: f4e2da93e70d4ddda403e260058f28d1
I20260810 04:11:12.124296 11876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:12.132072 11874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.121581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53266 (local address 127.10.249.190:46363)
0810 04:11:12.123282 (+ 1701us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.123292 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.123325 (+ 33us) server_negotiation.cc:407] Connection header received
0810 04:11:12.123450 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.123456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.123504 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.123643 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:12.124289 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.125168 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.125968 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.126376 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.126523 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.128876 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:12.128880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:12.128881 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:12.128893 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:12.130564 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.130921 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.130924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.130925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.131024 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.131233 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.131234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.131235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.131462 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:12.131681 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.131747 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.131888 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1658,"thread_start_us":65,"threads_started":1}
I20260810 04:11:12.140520 11876 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:12.141023 11876 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:12.147125 11876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 392c2f07490a478aa12523371b5334bd: Generated new TSK 0
I20260810 04:11:12.147305 11876 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:12.174852 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46363
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:12.255661 11893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:12.255841 11893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:12.255862 11893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:12.256829 11893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:12.256858 11893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:12.256881 11893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:12.258304 11893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46363
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:12.258487 11893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:12.258669 11893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:12.263664 11898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:12.263768 11899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:12.263660 11901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:12.263883 11893 server_base.cc:1034] running on GCE node
I20260810 04:11:12.264101 11893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:12.264396 11893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:12.265570 11893 hybrid_clock.cc:648] HybridClock initialized: now 1786335072265556 us; error 44 us; skew 500 ppm
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:12.268062 11893 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:12.268512 11893 webserver.cc:460] Webserver started at http://127.10.249.129:46423/ using document root <none> and password file <none>
I20260810 04:11:12.268739 11893 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:12.268807 11893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:12.268959 11893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:12.270099 11893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "68f1c21683e24ef18f44dbbc77bf949c"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "d1c2e2b4d7cc4a0e7d57d8a1ac080a92"
server_key_iv: "3e759d68aca653a77242326cd07c0971"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.270466 11893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "68f1c21683e24ef18f44dbbc77bf949c"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "d1c2e2b4d7cc4a0e7d57d8a1ac080a92"
server_key_iv: "3e759d68aca653a77242326cd07c0971"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.271806 11893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:12.272503 11908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.272670 11893 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:12.272784 11893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "68f1c21683e24ef18f44dbbc77bf949c"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "d1c2e2b4d7cc4a0e7d57d8a1ac080a92"
server_key_iv: "3e759d68aca653a77242326cd07c0971"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.272863 11893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:12.288180 11893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:12.290517 11893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:12.290632 11893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:12.290823 11893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:12.291184 11893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:12.291242 11893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.291285 11893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:12.291311 11893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.296887 11893 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:41401
I20260810 04:11:12.296993 12025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:41401 every 8 connection(s)
I20260810 04:11:12.297290 11893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:11:12.299408 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 11893
I20260810 04:11:12.299504 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:12.299682 11238 external_mini_cluster.cc:1428] Setting key fbe8c89efde66024577df28b862220b8
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:12.308444 11874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.298044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:50709 (local address 127.10.249.190:46363)
0810 04:11:12.298093 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.298095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.298319 (+ 224us) server_negotiation.cc:407] Connection header received
0810 04:11:12.299289 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.299290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.299307 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.299386 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:12.300101 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.300793 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.302372 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.302600 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.302696 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.305212 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:12.305214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:12.305214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:12.305223 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:12.306947 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.307365 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.307367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.307367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.307438 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.307745 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.307746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.307746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.307897 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:12.307976 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.308234 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.308334 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:11:12.308459 12028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.298017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46363 (local address 127.10.249.129:50709)
0810 04:11:12.298187 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:12.298230 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:12.299175 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:12.299438 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:12.299442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:12.299830 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:12.300028 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.300033 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.300888 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.300889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.302274 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.302277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.302718 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.302720 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.302850 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.303388 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:12.303398 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:12.305100 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:12.307035 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:12.307042 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:12.307044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:12.307287 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:12.307510 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:12.307511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:12.307511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:12.307673 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:12.307968 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:12.307973 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:12.308087 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 04:11:12.308176 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 04:11:12.308296 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260810 04:11:12.309059 12026 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46363
I20260810 04:11:12.309166 12026 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
I20260810 04:11:12.309356 12026 heartbeater.cc:511] Master 127.10.249.190:46363 requested a full tablet report, sending...
I20260810 04:11:12.309983 11830 ts_manager.cc:194] Registered new tserver with Master: 68f1c21683e24ef18f44dbbc77bf949c (127.10.249.129:41401)
I20260810 04:11:12.310703 11830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:50709
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:12.326268 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46363
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:12.408083 12031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:12.408303 12031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:12.408336 12031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:12.409363 12031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:12.409428 12031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:12.409466 12031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:12.411002 12031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46363
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:12.411255 12031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:12.411480 12031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:12.416433 12037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:12.416424 12036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:12.416410 12039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:12.416651 12031 server_base.cc:1034] running on GCE node
I20260810 04:11:12.416877 12031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:12.417109 12031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:12.418272 12031 hybrid_clock.cc:648] HybridClock initialized: now 1786335072418267 us; error 35 us; skew 500 ppm
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:12.420656 12031 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:12.421177 12031 webserver.cc:460] Webserver started at http://127.10.249.130:46383/ using document root <none> and password file <none>
I20260810 04:11:12.421427 12031 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:12.421494 12031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:12.421663 12031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:12.422935 12031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "75cd21614c194140960c31e06c05e195"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "74686ee00dd939e4e00301ae599ae573"
server_key_iv: "25c1f5bdc245e23c56db1016211f2534"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.423287 12031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "75cd21614c194140960c31e06c05e195"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "74686ee00dd939e4e00301ae599ae573"
server_key_iv: "25c1f5bdc245e23c56db1016211f2534"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.424616 12031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:11:12.425431 12046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.425609 12031 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:11:12.425705 12031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "75cd21614c194140960c31e06c05e195"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "74686ee00dd939e4e00301ae599ae573"
server_key_iv: "25c1f5bdc245e23c56db1016211f2534"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.425815 12031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:12.436445 12031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:12.438354 12031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:12.438513 12031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:12.438745 12031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:12.439054 12031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:12.439111 12031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.439154 12031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:12.439208 12031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.445021 12031 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:34787
I20260810 04:11:12.445075 12160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:34787 every 8 connection(s)
I20260810 04:11:12.445436 12031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:12.451400 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 12031
I20260810 04:11:12.451512 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:12.451733 11238 external_mini_cluster.cc:1428] Setting key 5e4244ca27f313ceca292b8473b0cf59
I20260810 04:11:12.454366 11874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.446204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:50943 (local address 127.10.249.190:46363)
0810 04:11:12.446270 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.446272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.446451 (+ 179us) server_negotiation.cc:407] Connection header received
0810 04:11:12.447301 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.447301 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.447310 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.447356 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:12.447870 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.448307 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.449162 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.449321 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.449365 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.451278 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:12.451280 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:12.451281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:12.451288 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:12.452869 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.453328 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.453329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.453329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.453392 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.453619 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.453620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.453620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.453755 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:12.453903 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.454140 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.454237 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:11:12.454774 12163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.446153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46363 (local address 127.10.249.130:50943)
0810 04:11:12.446328 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:12.446367 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:12.447221 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:12.447411 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:12.447414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:12.447633 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:12.447804 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.447807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.448376 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.448377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.449093 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.449095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.449384 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.449385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.449473 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.449973 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:12.449981 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:12.451196 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:12.452944 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:12.452949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:12.452951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:12.453200 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:12.453458 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:12.453459 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:12.453459 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:12.453552 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:12.453905 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:12.453910 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:12.454014 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 04:11:12.454096 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 04:11:12.454254 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
I20260810 04:11:12.455221 12161 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46363
I20260810 04:11:12.455317 12161 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:12.455492 12161 heartbeater.cc:511] Master 127.10.249.190:46363 requested a full tablet report, sending...
I20260810 04:11:12.455899 11830 ts_manager.cc:194] Registered new tserver with Master: 75cd21614c194140960c31e06c05e195 (127.10.249.130:34787)
I20260810 04:11:12.456384 11830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:50943
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:12.477224 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46363
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:12.559276 12166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:12.559563 12166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:12.559607 12166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:12.560917 12166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:12.561019 12166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:12.561084 12166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:12.562795 12166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46363
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:12.563139 12166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:12.563388 12166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:12.568589 12175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:12.568538 12171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:12.568545 12172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:12.568737 12166 server_base.cc:1034] running on GCE node
I20260810 04:11:12.569011 12166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:12.569288 12166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:12.570451 12166 hybrid_clock.cc:648] HybridClock initialized: now 1786335072570445 us; error 50 us; skew 500 ppm
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:12.572857 12166 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:12.573251 12166 webserver.cc:460] Webserver started at http://127.10.249.131:45255/ using document root <none> and password file <none>
I20260810 04:11:12.573480 12166 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:12.573544 12166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:12.573704 12166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:12.574750 12166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "26f048b99be5482abfbb53f2d7c5abc8"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "1fb890f8d2e00525a81a6345ea4a285d"
server_key_iv: "6a71a8eba665e6e659c6258f3ed69515"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.575090 12166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "26f048b99be5482abfbb53f2d7c5abc8"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "1fb890f8d2e00525a81a6345ea4a285d"
server_key_iv: "6a71a8eba665e6e659c6258f3ed69515"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.576396 12166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:12.577155 12182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.577323 12166 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:12.577430 12166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "26f048b99be5482abfbb53f2d7c5abc8"
format_stamp: "Formatted at 2026-08-10 04:11:12 on dist-test-slave-0kls"
server_key: "1fb890f8d2e00525a81a6345ea4a285d"
server_key_iv: "6a71a8eba665e6e659c6258f3ed69515"
server_key_version: "encryptionkey@0"
I20260810 04:11:12.577502 12166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:12.592581 12166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:12.594513 12166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:12.594691 12166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:12.594931 12166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:12.595247 12166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:12.595302 12166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.595346 12166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:12.595369 12166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:12.601388 12166 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:41533
I20260810 04:11:12.601431 12300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:41533 every 8 connection(s)
I20260810 04:11:12.601854 12166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:12.602542 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 12166
I20260810 04:11:12.602679 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:12.602866 11238 external_mini_cluster.cc:1428] Setting key 3592bad2f8ca2f0f8230496fc0600277
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:12.611217 11874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.602587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:55551 (local address 127.10.249.190:46363)
0810 04:11:12.602637 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.602640 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.602881 (+ 241us) server_negotiation.cc:407] Connection header received
0810 04:11:12.603980 (+ 1099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.603981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.603994 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.604039 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:12.604681 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.605185 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.606367 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.606588 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.606677 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.608790 (+ 2113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:12.608792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:12.608792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:12.608799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:12.610018 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.610369 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.610370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.610371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.610424 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.610678 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.610678 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.610679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.610780 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:12.610830 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.611072 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.611141 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:11:12.611366 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.602586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46363 (local address 127.10.249.131:55551)
0810 04:11:12.602772 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:12.602811 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:12.603872 (+ 1061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:12.604132 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:12.604136 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:12.604385 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:12.604575 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.604579 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.605290 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.605293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.606279 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.606282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.606713 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.606714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.606833 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.607322 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:12.607332 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:12.608710 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:12.610085 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:12.610091 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:12.610093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:12.610305 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:12.610481 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:12.610482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:12.610482 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:12.610613 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:12.610842 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:12.610847 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:12.610962 (+ 115us) client_negotiation.cc:769] Sending connection context
0810 04:11:12.611044 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 04:11:12.611162 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":104,"threads_started":1}
I20260810 04:11:12.611871 12301 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46363
I20260810 04:11:12.611984 12301 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:12.612166 12301 heartbeater.cc:511] Master 127.10.249.190:46363 requested a full tablet report, sending...
I20260810 04:11:12.612568 11830 ts_manager.cc:194] Registered new tserver with Master: 26f048b99be5482abfbb53f2d7c5abc8 (127.10.249.131:41533)
I20260810 04:11:12.613011 11830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:55551
I20260810 04:11:12.614365 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:11:12.621433 11874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.615874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53276 (local address 127.10.249.190:46363)
0810 04:11:12.615936 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.615938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.616059 (+ 121us) server_negotiation.cc:407] Connection header received
0810 04:11:12.616093 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.616094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.616102 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.616145 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:12.616642 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.617075 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.617716 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.617993 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.618077 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.619109 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:12.619111 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:12.619111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:12.619119 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:12.620240 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.620576 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.620577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.620578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.620632 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.620862 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.620863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.620863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.621019 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:12.621123 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.621230 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.621316 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:11:12.623711 11830 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:12.625247 11830 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:12.631728 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.627572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51996 (local address 127.10.249.129:41401)
0810 04:11:12.627850 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.627856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.627867 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:11:12.627910 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.627913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.627930 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.628013 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:12.628214 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.629250 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.630724 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.631287 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.631368 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.631419 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.631593 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.631634 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":113,"threads_started":1}
I20260810 04:11:12.631735 12309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.627448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:41401 (local address 127.0.0.1:51996)
0810 04:11:12.627627 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:12.627687 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:12.627772 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:12.628036 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:12.628039 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:12.628042 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:12.628115 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.628117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.629365 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.629366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.630619 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.630622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.631368 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.631369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.631457 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.631470 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 04:11:12.631577 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 04:11:12.631634 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":20,"thread_start_us":69,"threads_started":1}
I20260810 04:11:12.632030 12314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.627835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53032 (local address 127.10.249.130:34787)
0810 04:11:12.628013 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.628017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.628123 (+ 106us) server_negotiation.cc:407] Connection header received
0810 04:11:12.628194 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.628196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.628214 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.628293 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:12.628426 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.629482 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.630703 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.631299 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.631365 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.631412 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.631915 (+ 503us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.631956 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260810 04:11:12.631743 12310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.627485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:34787 (local address 127.0.0.1:53032)
0810 04:11:12.628048 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:12.628059 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:12.628116 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:12.628300 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:12.628301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:12.628303 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:12.628340 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.628342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.629607 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.629608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.630620 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.630623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.631446 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.631447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.631532 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.631537 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:11:12.631590 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:11:12.631637 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":21,"thread_start_us":72,"threads_started":1}
I20260810 04:11:12.632252 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.627780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44112 (local address 127.10.249.131:41533)
0810 04:11:12.627950 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.627955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.628186 (+ 231us) server_negotiation.cc:407] Connection header received
0810 04:11:12.628449 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.628452 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.628468 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.628538 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:12.628761 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.629757 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.630974 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.631635 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.631696 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.631743 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.632072 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.632119 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260810 04:11:12.632623 11959 tablet_service.cc:1467] Processing CreateTablet for tablet a304aa74ffda478185338561c794a144 (DEFAULT_TABLE table=test-table [id=7d120c77d6394ab780a4e5dbd93e7114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:12.632938 12094 tablet_service.cc:1467] Processing CreateTablet for tablet a304aa74ffda478185338561c794a144 (DEFAULT_TABLE table=test-table [id=7d120c77d6394ab780a4e5dbd93e7114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:12.633046 11959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a304aa74ffda478185338561c794a144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:12.633289 12094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a304aa74ffda478185338561c794a144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:12.635653 12315 tablet_bootstrap.cc:492] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c: Bootstrap starting.
I20260810 04:11:12.635710 12312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.627685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:41533 (local address 127.0.0.1:44112)
0810 04:11:12.628121 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:12.628131 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:12.628230 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:12.628624 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:12.628625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:12.628627 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:12.628682 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.628684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.629867 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.629869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.630899 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.630902 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.631778 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.631779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.631848 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.631852 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:12.631912 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:11:12.631948 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":59,"threads_started":1}
I20260810 04:11:12.635703 12316 tablet_bootstrap.cc:492] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195: Bootstrap starting.
I20260810 04:11:12.636268 12315 tablet_bootstrap.cc:654] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:12.636330 12232 tablet_service.cc:1467] Processing CreateTablet for tablet a304aa74ffda478185338561c794a144 (DEFAULT_TABLE table=test-table [id=7d120c77d6394ab780a4e5dbd93e7114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:12.636618 12232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a304aa74ffda478185338561c794a144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:12.636618 12316 tablet_bootstrap.cc:654] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:12.636809 12315 log.cc:824] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:12.637140 12316 log.cc:824] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:12.637596 12315 tablet_bootstrap.cc:492] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c: No bootstrap required, opened a new log
I20260810 04:11:12.637667 12315 ts_tablet_manager.cc:1397] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:12.637943 12316 tablet_bootstrap.cc:492] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195: No bootstrap required, opened a new log
I20260810 04:11:12.638015 12316 ts_tablet_manager.cc:1397] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:12.639036 12315 raft_consensus.cc:348] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.639190 12315 raft_consensus.cc:374] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:12.639235 12315 raft_consensus.cc:729] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f1c21683e24ef18f44dbbc77bf949c, State: Initialized, Role: FOLLOWER
I20260810 04:11:12.639374 12315 consensus_queue.cc:260] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.639672 12315 ts_tablet_manager.cc:1428] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:12.639816 12026 heartbeater.cc:503] Master 127.10.249.190:46363 was elected leader, sending a full tablet report...
I20260810 04:11:12.639954 12320 tablet_bootstrap.cc:492] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8: Bootstrap starting.
I20260810 04:11:12.640595 12320 tablet_bootstrap.cc:654] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:12.640520 12316 raft_consensus.cc:348] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.640689 12316 raft_consensus.cc:374] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:12.640740 12316 raft_consensus.cc:729] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75cd21614c194140960c31e06c05e195, State: Initialized, Role: FOLLOWER
I20260810 04:11:12.640864 12316 consensus_queue.cc:260] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.641227 12320 log.cc:824] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:12.641332 12316 ts_tablet_manager.cc:1428] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:11:12.641319 12161 heartbeater.cc:503] Master 127.10.249.190:46363 was elected leader, sending a full tablet report...
I20260810 04:11:12.642055 12320 tablet_bootstrap.cc:492] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8: No bootstrap required, opened a new log
I20260810 04:11:12.642135 12320 ts_tablet_manager.cc:1397] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:12.643574 12320 raft_consensus.cc:348] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.643740 12320 raft_consensus.cc:374] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:12.643786 12320 raft_consensus.cc:729] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26f048b99be5482abfbb53f2d7c5abc8, State: Initialized, Role: FOLLOWER
I20260810 04:11:12.643886 12320 consensus_queue.cc:260] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.644105 12320 ts_tablet_manager.cc:1428] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:11:12.644132 12301 heartbeater.cc:503] Master 127.10.249.190:46363 was elected leader, sending a full tablet report...
W20260810 04:11:12.696017 12162 tablet.cc:2369] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:11:12.798084 12027 tablet.cc:2369] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:11:12.852468 12302 tablet.cc:2369] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:11:12.938783 12323 raft_consensus.cc:482] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:12.938941 12323 raft_consensus.cc:504] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.939399 12323 leader_election.cc:288] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f1c21683e24ef18f44dbbc77bf949c (127.10.249.129:41401), 75cd21614c194140960c31e06c05e195 (127.10.249.130:34787)
I20260810 04:11:12.943472 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.939717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:47683 (local address 127.10.249.129:41401)
0810 04:11:12.939787 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.939789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.939802 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:11:12.939839 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.939840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.939851 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.939914 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:12.940129 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.940895 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.942529 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.943100 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.943189 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.943195 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.943366 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.943402 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:11:12.943471 12314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.939758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:47669 (local address 127.10.249.130:34787)
0810 04:11:12.939824 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.939826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.939958 (+ 132us) server_negotiation.cc:407] Connection header received
0810 04:11:12.939988 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.939989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.940002 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.940046 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:12.940230 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.940933 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.942529 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.943116 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.943186 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.943195 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.943366 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.943403 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:11:12.943466 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.939594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:41401 (local address 127.10.249.131:47683)
0810 04:11:12.939696 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:12.939710 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:12.939780 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:12.939942 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:12.939943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:12.939945 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:12.940027 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.940047 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.941020 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.941020 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.942433 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.942436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.943199 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.943200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.943282 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.943284 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:11:12.943340 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:11:12.943380 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":78}
I20260810 04:11:12.943475 12324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.939648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:34787 (local address 127.10.249.131:47669)
0810 04:11:12.939853 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:12.939861 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:12.939936 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:12.940075 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:12.940076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:12.940078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:12.940139 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.940140 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.941019 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.941020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.942433 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:12.942436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.943199 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.943200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:12.943277 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.943282 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:11:12.943340 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 04:11:12.943380 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":94,"thread_start_us":122,"threads_started":1}
I20260810 04:11:12.943849 11979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a304aa74ffda478185338561c794a144" candidate_uuid: "26f048b99be5482abfbb53f2d7c5abc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f1c21683e24ef18f44dbbc77bf949c" is_pre_election: true
I20260810 04:11:12.943836 12114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a304aa74ffda478185338561c794a144" candidate_uuid: "26f048b99be5482abfbb53f2d7c5abc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75cd21614c194140960c31e06c05e195" is_pre_election: true
I20260810 04:11:12.944029 12114 raft_consensus.cc:2454] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26f048b99be5482abfbb53f2d7c5abc8 in term 0.
I20260810 04:11:12.944029 11979 raft_consensus.cc:2454] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26f048b99be5482abfbb53f2d7c5abc8 in term 0.
I20260810 04:11:12.944237 12183 leader_election.cc:302] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26f048b99be5482abfbb53f2d7c5abc8, 75cd21614c194140960c31e06c05e195; no voters:
I20260810 04:11:12.944393 12323 raft_consensus.cc:2781] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:12.944471 12323 raft_consensus.cc:482] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:12.944489 12323 raft_consensus.cc:3037] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:12.945155 12323 raft_consensus.cc:504] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.945297 12323 leader_election.cc:288] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [CANDIDATE]: Term 1 election: Requested vote from peers 68f1c21683e24ef18f44dbbc77bf949c (127.10.249.129:41401), 75cd21614c194140960c31e06c05e195 (127.10.249.130:34787)
I20260810 04:11:12.945456 11979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a304aa74ffda478185338561c794a144" candidate_uuid: "26f048b99be5482abfbb53f2d7c5abc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f1c21683e24ef18f44dbbc77bf949c"
I20260810 04:11:12.945497 12114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a304aa74ffda478185338561c794a144" candidate_uuid: "26f048b99be5482abfbb53f2d7c5abc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75cd21614c194140960c31e06c05e195"
I20260810 04:11:12.945540 11979 raft_consensus.cc:3037] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:12.945593 12114 raft_consensus.cc:3037] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:12.946298 12114 raft_consensus.cc:2454] T a304aa74ffda478185338561c794a144 P 75cd21614c194140960c31e06c05e195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26f048b99be5482abfbb53f2d7c5abc8 in term 1.
I20260810 04:11:12.946385 11979 raft_consensus.cc:2454] T a304aa74ffda478185338561c794a144 P 68f1c21683e24ef18f44dbbc77bf949c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26f048b99be5482abfbb53f2d7c5abc8 in term 1.
I20260810 04:11:12.946456 12183 leader_election.cc:302] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26f048b99be5482abfbb53f2d7c5abc8, 75cd21614c194140960c31e06c05e195; no voters:
I20260810 04:11:12.946594 12323 raft_consensus.cc:2781] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:12.946763 12323 raft_consensus.cc:686] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [term 1 LEADER]: Becoming Leader. State: Replica: 26f048b99be5482abfbb53f2d7c5abc8, State: Running, Role: LEADER
I20260810 04:11:12.946857 12323 consensus_queue.cc:237] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } }
I20260810 04:11:12.947652 11830 catalog_manager.cc:5495] T a304aa74ffda478185338561c794a144 P 26f048b99be5482abfbb53f2d7c5abc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26f048b99be5482abfbb53f2d7c5abc8 (127.10.249.131). New cstate: current_term: 1 leader_uuid: "26f048b99be5482abfbb53f2d7c5abc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1c21683e24ef18f44dbbc77bf949c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 41401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26f048b99be5482abfbb53f2d7c5abc8" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75cd21614c194140960c31e06c05e195" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34787 } health_report { overall_health: UNKNOWN } } }
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:12.987495 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:12.980783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.10.249.129:41401)
0810 04:11:12.980851 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:12.980854 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:12.980969 (+ 115us) server_negotiation.cc:407] Connection header received
0810 04:11:12.981064 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:12.981065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:12.981077 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:12.981141 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:12.981729 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.982253 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.982981 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:12.983151 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:12.983225 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:12.985253 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:12.985264 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:12.985264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:12.985271 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:12.986614 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.986918 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.986921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.986921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.986991 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:12.987119 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:12.987119 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:12.987120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:12.987228 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:12.987314 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:12.987363 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 04:11:12.987435 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 04:11:12 dist-test-slave-0kls krb5kdc[11783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:11:13 dist-test-slave-0kls krb5kdc[11783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335072, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:13.010456 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:13.003773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52010 (local address 127.10.249.129:41401)
0810 04:11:13.003873 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:13.003875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:13.003927 (+ 52us) server_negotiation.cc:407] Connection header received
0810 04:11:13.003977 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:13.003978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:13.003986 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:13.004031 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:13.004565 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:13.005037 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:13.005909 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:13.006074 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:13.006122 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:13.008274 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:13.008275 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:13.008275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:13.008282 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:13.009499 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:13.009776 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:13.009777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:13.009777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:13.009900 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:13.010052 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:13.010052 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:13.010052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:13.010127 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:13.010196 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:13.010304 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 04:11:13.010362 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 04:11:13 dist-test-slave-0kls krb5kdc[11783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:11:13 dist-test-slave-0kls krb5kdc[11783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:13.033425 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:13.027065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52012 (local address 127.10.249.129:41401)
0810 04:11:13.027124 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:13.027127 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:13.027220 (+ 93us) server_negotiation.cc:407] Connection header received
0810 04:11:13.027299 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:13.027300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:13.027311 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:13.027363 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:13.027871 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:13.028372 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:13.029031 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:13.029215 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:13.029281 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:13.031230 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:13.031232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:13.031232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:13.031240 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:13.032361 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:13.032732 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:13.032734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:13.032734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:13.032805 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:13.032990 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:13.032991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:13.032992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:13.033082 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:13.033181 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:13.033264 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 04:11:13.033333 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260810 04:11:13.033950 11939 tablet_service.cc:2908] Rejecting scan request for tablet a304aa74ffda478185338561c794a144: Uninitialized: clean time has not yet been initialized
I20260810 04:11:13.034808 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 11893
I20260810 04:11:13.040198 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 12031
I20260810 04:11:13.045656 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 12166
I20260810 04:11:13.050203 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 11797
2026-08-10T04:11:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2163 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:13 dist-test-slave-0kls krb5kdc[12340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:13 dist-test-slave-0kls krb5kdc[12340](info): set up 2 sockets
Aug 10 04:11:13 dist-test-slave-0kls krb5kdc[12340](info): commencing operation
krb5kdc: starting...
W20260810 04:11:14.043859 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.973s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:14.154533 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:41047
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:41047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:14.229629 12353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:14.229813 12353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:14.229833 12353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:14.230870 12353 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:14.230908 12353 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 04:11:14.230921 12353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:14.230932 12353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:14.230978 12353 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:14.230994 12353 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:14.232421 12353 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:41047
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:41047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:14.232663 12353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:14.232892 12353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:14.237375 12359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:14.237390 12358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:14.237406 12353 server_base.cc:1034] running on GCE node
W20260810 04:11:14.237401 12361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:14.237890 12353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:14.238153 12353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:14.239332 12353 hybrid_clock.cc:648] HybridClock initialized: now 1786335074239319 us; error 24 us; skew 500 ppm
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:14.246417 12353 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:14.246765 12353 webserver.cc:460] Webserver started at http://127.10.249.190:41889/ using document root <none> and password file <none>
I20260810 04:11:14.246937 12353 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:14.246973 12353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:14.247051 12353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:14.247928 12353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "911c2c2b49f04176ad9d12168855fe9e"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "a8e3acb5b0ac52bffc6b10cdd0f8d0d7"
server_key_iv: "67df06a1e78d913b80ca1cb9a21b2c37"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.248224 12353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "911c2c2b49f04176ad9d12168855fe9e"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "a8e3acb5b0ac52bffc6b10cdd0f8d0d7"
server_key_iv: "67df06a1e78d913b80ca1cb9a21b2c37"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.249374 12353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:14.250039 12369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:14.250183 12353 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:14.250262 12353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "911c2c2b49f04176ad9d12168855fe9e"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "a8e3acb5b0ac52bffc6b10cdd0f8d0d7"
server_key_iv: "67df06a1e78d913b80ca1cb9a21b2c37"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.250315 12353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:14.257917 12353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:14.259897 12353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:14.260000 12353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:14.264621 12353 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:41047
I20260810 04:11:14.264721 12434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:41047 every 8 connection(s)
I20260810 04:11:14.265007 12353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:14.265658 12435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:14.267815 12435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e: Bootstrap starting.
I20260810 04:11:14.268348 12435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:14.268618 12435 log.cc:824] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:14.268849 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 12353
I20260810 04:11:14.268958 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:14.269114 11238 external_mini_cluster.cc:1428] Setting key 82c9869f9a867895d6413ae7fad2fafd
I20260810 04:11:14.269356 12435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e: No bootstrap required, opened a new log
I20260810 04:11:14.272255 12435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c2c2b49f04176ad9d12168855fe9e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41047 } }
I20260810 04:11:14.272439 12435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:14.272472 12435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911c2c2b49f04176ad9d12168855fe9e, State: Initialized, Role: FOLLOWER
I20260810 04:11:14.272584 12435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c2c2b49f04176ad9d12168855fe9e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41047 } }
I20260810 04:11:14.272648 12435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:14.272694 12435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:14.272737 12435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:14.273303 12435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c2c2b49f04176ad9d12168855fe9e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41047 } }
I20260810 04:11:14.273391 12435 leader_election.cc:302] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 911c2c2b49f04176ad9d12168855fe9e; no voters:
I20260810 04:11:14.273618 12435 leader_election.cc:288] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:14.273643 12440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:14.273831 12440 raft_consensus.cc:686] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [term 1 LEADER]: Becoming Leader. State: Replica: 911c2c2b49f04176ad9d12168855fe9e, State: Running, Role: LEADER
I20260810 04:11:14.273933 12440 consensus_queue.cc:237] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c2c2b49f04176ad9d12168855fe9e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41047 } }
I20260810 04:11:14.273975 12435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:14.274246 12440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "911c2c2b49f04176ad9d12168855fe9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c2c2b49f04176ad9d12168855fe9e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41047 } } }
I20260810 04:11:14.274313 12440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:14.274433 12440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 911c2c2b49f04176ad9d12168855fe9e. Latest consensus state: current_term: 1 leader_uuid: "911c2c2b49f04176ad9d12168855fe9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "911c2c2b49f04176ad9d12168855fe9e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41047 } } }
I20260810 04:11:14.274500 12440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e [sys.catalog]: This master's current role is: LEADER
W20260810 04:11:14.275803 12455 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:11:14.275883 12455 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:11:14.275955 12444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:14.276137 12444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:14.277459 12444 catalog_manager.cc:1347] Generated new cluster ID: 04d76bace2bf452ab353529ade2d18e1
I20260810 04:11:14.277510 12444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:11:14.280756 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.269599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59346 (local address 127.10.249.190:41047)
0810 04:11:14.269847 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.269857 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.269887 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:11:14.270629 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.270637 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.270697 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.270832 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:14.271428 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.272830 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.273652 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.274271 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.274381 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.276955 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:14.276959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:14.276959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:14.276970 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:14.278729 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.279135 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.279138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.279138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.279237 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.279425 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.279426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.279426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.279774 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:14.279916 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.280400 (+ 484us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.280534 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":76,"threads_started":1}
I20260810 04:11:14.288121 12444 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:14.288564 12444 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:14.292775 12444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e: Generated new TSK 0
I20260810 04:11:14.292960 12444 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:14.326787 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41047
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:14.425261 12461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:14.425437 12461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:14.425458 12461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:14.426513 12461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:14.426550 12461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:14.426569 12461 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:11:14.426622 12461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:14.427886 12461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:41047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:14.428110 12461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:14.428321 12461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:14.433113 12466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:14.433287 12461 server_base.cc:1034] running on GCE node
W20260810 04:11:14.433120 12469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:14.433193 12467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:14.433547 12461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:14.433754 12461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:14.434924 12461 hybrid_clock.cc:648] HybridClock initialized: now 1786335074434915 us; error 26 us; skew 500 ppm
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:14.437299 12461 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:14.437744 12461 webserver.cc:460] Webserver started at http://127.10.249.129:43383/ using document root <none> and password file <none>
I20260810 04:11:14.437980 12461 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:14.438050 12461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:14.438202 12461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:14.439116 12461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "a1455dc15d604bc98e74d0c092f1c988"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "d4d91e9700399c382e8af337460d25e4"
server_key_iv: "4d4e61e459a0f416476a032ac34315b2"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.439450 12461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "a1455dc15d604bc98e74d0c092f1c988"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "d4d91e9700399c382e8af337460d25e4"
server_key_iv: "4d4e61e459a0f416476a032ac34315b2"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.440768 12461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:11:14.441499 12476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:14.441704 12461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:14.441828 12461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "a1455dc15d604bc98e74d0c092f1c988"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "d4d91e9700399c382e8af337460d25e4"
server_key_iv: "4d4e61e459a0f416476a032ac34315b2"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.441915 12461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:14.450852 12461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:14.453094 12461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:14.453248 12461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:14.453759 12461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:14.453828 12461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:14.453864 12461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:14.453887 12461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:14.460628 12461 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:42205
I20260810 04:11:14.460712 12596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:42205 every 8 connection(s)
I20260810 04:11:14.461027 12461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:11:14.461853 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 12461
I20260810 04:11:14.461968 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:14.462145 11238 external_mini_cluster.cc:1428] Setting key fef334bd2a13b61204a0d91d6c270fce
I20260810 04:11:14.462458 12485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.454166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41047 (local address 127.10.249.129:50043)
0810 04:11:14.454322 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.454354 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.454756 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.454985 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.454988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.455200 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:14.455354 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.455357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.455988 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.455989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.456720 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.456723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.457093 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.457095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.457198 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.457637 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:14.457646 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:14.459032 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:14.460786 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.460791 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.460793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.461091 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.461329 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.461331 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.461331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.461450 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.461738 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:14.461745 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:14.461935 (+ 190us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.462063 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.462244 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
I20260810 04:11:14.462807 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.454179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:50043 (local address 127.10.249.190:41047)
0810 04:11:14.454239 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.454242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.454417 (+ 175us) server_negotiation.cc:407] Connection header received
0810 04:11:14.454850 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.454852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.454863 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.454914 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:14.455444 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.455903 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.456811 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.457004 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.457080 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.459121 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:14.459122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:14.459122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:14.459130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:14.460711 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.461172 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.461173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.461174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.461247 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.461529 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.461530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.461530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.461663 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:14.461715 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.462591 (+ 876us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.462691 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:11:14.463235 12597 heartbeater.cc:347] Connected to a master server at 127.10.249.190:41047
I20260810 04:11:14.463316 12597 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:14.463490 12597 heartbeater.cc:511] Master 127.10.249.190:41047 requested a full tablet report, sending...
I20260810 04:11:14.463979 12385 ts_manager.cc:194] Registered new tserver with Master: a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205)
I20260810 04:11:14.464720 12385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:50043
I20260810 04:11:14.470039 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.464144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:40047 (local address 127.10.249.190:41047)
0810 04:11:14.464182 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.464184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.464323 (+ 139us) server_negotiation.cc:407] Connection header received
0810 04:11:14.464414 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.464415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.464427 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.464456 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:14.464939 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.465411 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.466358 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.466555 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.466638 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.467513 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:14.467514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:14.467515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:14.467521 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:14.468890 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.469231 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.469232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.469233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.469289 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.469488 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.469489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.469489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.469598 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:14.469673 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.469857 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.469953 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:11:14.470243 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.464156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41047 (local address 127.10.249.129:40047)
0810 04:11:14.464270 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.464279 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.464348 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.464514 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.464515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.464731 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:14.464837 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.464840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.465505 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.465506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.466271 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.466274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.466640 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.466648 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.466720 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.467143 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:14.467148 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:14.467397 (+ 249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:14.468990 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.468991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.468991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.469160 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.469360 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.469361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.469361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.469417 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.469667 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:14.469667 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:14.469714 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.469832 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.469989 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":76,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:14.487908 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41047
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:14.561731 12606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:14.561928 12606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:14.561954 12606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:14.563081 12606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:14.563123 12606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:14.563143 12606 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:11:14.563195 12606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:14.564407 12606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:41047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:14.564630 12606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:14.564839 12606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:14.569175 12612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:14.569229 12606 server_base.cc:1034] running on GCE node
W20260810 04:11:14.569195 12611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:14.569202 12614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:14.569494 12606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:14.569757 12606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:14.570926 12606 hybrid_clock.cc:648] HybridClock initialized: now 1786335074570914 us; error 28 us; skew 500 ppm
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:14.573302 12606 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:14.573710 12606 webserver.cc:460] Webserver started at http://127.10.249.130:36443/ using document root <none> and password file <none>
I20260810 04:11:14.573961 12606 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:14.574003 12606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:14.574170 12606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:14.575147 12606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "828d06632311462490afb959d13108da"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "696ac00094defe11a0b62132d3e388ca"
server_key_iv: "5bc6d7e5f4386def40299bd84b1a0aa0"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.575456 12606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "828d06632311462490afb959d13108da"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "696ac00094defe11a0b62132d3e388ca"
server_key_iv: "5bc6d7e5f4386def40299bd84b1a0aa0"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.576737 12606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:14.577358 12621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:14.577517 12606 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:14.577600 12606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "828d06632311462490afb959d13108da"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "696ac00094defe11a0b62132d3e388ca"
server_key_iv: "5bc6d7e5f4386def40299bd84b1a0aa0"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.577652 12606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:14.585016 12606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:14.586721 12606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:14.586822 12606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:14.587266 12606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:14.587307 12606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:14.587327 12606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:14.587338 12606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:14.593667 12606 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:46527
I20260810 04:11:14.593715 12743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:46527 every 8 connection(s)
I20260810 04:11:14.594089 12606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:11:14.596433 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.587717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:35287 (local address 127.10.249.190:41047)
0810 04:11:14.587785 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.587788 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.587964 (+ 176us) server_negotiation.cc:407] Connection header received
0810 04:11:14.588365 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.588366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.588380 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.588459 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:14.589221 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.590006 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.591372 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.591710 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.591795 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.593928 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:14.593930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:14.593930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:14.593937 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:14.595296 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.595714 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.595715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.595715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.595770 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.595964 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.595965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.595965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.596058 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:14.596102 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.596315 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.596377 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:11:14.596575 12630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.587646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41047 (local address 127.10.249.130:35287)
0810 04:11:14.587871 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.587896 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.588283 (+ 387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.588531 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.588535 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.588844 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:14.589110 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.589116 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.590108 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.590109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.591279 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.591282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.591796 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.591797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.591900 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.592387 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:14.592398 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:14.593852 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:14.595362 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.595367 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.595369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.595560 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.595831 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.595831 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.595832 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.595912 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.596122 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:14.596125 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:14.596219 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.596289 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.596388 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":77,"threads_started":1}
I20260810 04:11:14.597067 12744 heartbeater.cc:347] Connected to a master server at 127.10.249.190:41047
I20260810 04:11:14.597149 12744 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:14.597317 12744 heartbeater.cc:511] Master 127.10.249.190:41047 requested a full tablet report, sending...
I20260810 04:11:14.597715 12386 ts_manager.cc:194] Registered new tserver with Master: 828d06632311462490afb959d13108da (127.10.249.130:46527)
I20260810 04:11:14.598201 12386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:35287
I20260810 04:11:14.602675 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 12606
I20260810 04:11:14.602783 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:14.602988 11238 external_mini_cluster.cc:1428] Setting key 4340ea2abef4d43b8a9c0b18f9c9a2e0
I20260810 04:11:14.603101 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.598091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:36067 (local address 127.10.249.190:41047)
0810 04:11:14.598312 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.598313 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.598320 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:11:14.598334 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.598334 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.598341 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.598413 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:14.598746 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.599120 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.599663 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.599837 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.599883 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.600591 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:14.600592 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:14.600592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:14.600597 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:14.602040 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.602323 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.602324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.602324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.602370 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.602546 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.602546 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.602546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.602666 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:14.602713 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.602937 (+ 224us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.603000 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191}
I20260810 04:11:14.603106 12750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.598029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41047 (local address 127.10.249.130:36067)
0810 04:11:14.598145 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.598153 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.598198 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.598420 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.598421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.598604 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:14.598661 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.598663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.599210 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.599211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.599601 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.599602 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.599899 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.599900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.599952 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.600271 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:14.600275 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:14.600518 (+ 243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:14.602105 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.602105 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.602106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.602262 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.602425 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.602425 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.602426 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.602474 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.602729 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:14.602730 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:14.602782 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.602905 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.603009 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":63,"threads_started":1}
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:14.626303 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41047
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:14.700373 12753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:14.700551 12753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:14.700572 12753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:14.701546 12753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:14.701576 12753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:14.701593 12753 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:11:14.701609 12753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:14.703012 12753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:41047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:14.703193 12753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:14.703348 12753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:14.707688 12761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:14.707746 12758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:14.707876 12753 server_base.cc:1034] running on GCE node
W20260810 04:11:14.707934 12759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:14.708133 12753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:14.708382 12753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:14.709556 12753 hybrid_clock.cc:648] HybridClock initialized: now 1786335074709552 us; error 36 us; skew 500 ppm
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:14.712025 12753 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:14.712472 12753 webserver.cc:460] Webserver started at http://127.10.249.131:39377/ using document root <none> and password file <none>
I20260810 04:11:14.712688 12753 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:14.712754 12753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:14.712913 12753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:14.713883 12753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "8879baf9e44e428ca17843091d9fec42"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "5b88a9f497752116587a1263243abba4"
server_key_iv: "98d164b0cad4f4a2cceb12dc25f6fe00"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.714215 12753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "8879baf9e44e428ca17843091d9fec42"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "5b88a9f497752116587a1263243abba4"
server_key_iv: "98d164b0cad4f4a2cceb12dc25f6fe00"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.715344 12753 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:14.715940 12768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:14.716094 12753 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:14.716189 12753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "8879baf9e44e428ca17843091d9fec42"
format_stamp: "Formatted at 2026-08-10 04:11:14 on dist-test-slave-0kls"
server_key: "5b88a9f497752116587a1263243abba4"
server_key_iv: "98d164b0cad4f4a2cceb12dc25f6fe00"
server_key_version: "encryptionkey@0"
I20260810 04:11:14.716262 12753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:14.726373 12753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:14.728480 12753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:14.728632 12753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:14.729130 12753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:14.729193 12753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:14.729239 12753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:14.729261 12753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:14.736550 12753 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:38009
I20260810 04:11:14.736706 12886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:38009 every 8 connection(s)
I20260810 04:11:14.736943 12753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:14.738821 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.729518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:47313 (local address 127.10.249.190:41047)
0810 04:11:14.729605 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.729608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.729805 (+ 197us) server_negotiation.cc:407] Connection header received
0810 04:11:14.730305 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.730306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.730320 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.730394 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:14.730960 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.731709 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.733346 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.733548 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.733632 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.736188 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:14.736189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:14.736190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:14.736197 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:14.737705 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.738100 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.738100 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.738101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.738154 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.738365 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.738365 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.738365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.738460 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:14.738504 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.738707 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.738762 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 04:11:14.738970 12777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.729500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41047 (local address 127.10.249.131:47313)
0810 04:11:14.729655 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.729702 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.730214 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.730451 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.730454 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.730657 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:14.730865 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.730868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.731809 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.731810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.733249 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.733252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.733655 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.733656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.733776 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.734327 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:14.734337 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:14.736078 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:14.737774 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.737778 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.737779 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.738031 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.738214 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.738214 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.738214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.738302 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.738513 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:14.738517 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:14.738615 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.738690 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.738796 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":92,"threads_started":1}
I20260810 04:11:14.739396 12887 heartbeater.cc:347] Connected to a master server at 127.10.249.190:41047
I20260810 04:11:14.739475 12887 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:14.739655 12887 heartbeater.cc:511] Master 127.10.249.190:41047 requested a full tablet report, sending...
I20260810 04:11:14.740075 12386 ts_manager.cc:194] Registered new tserver with Master: 8879baf9e44e428ca17843091d9fec42 (127.10.249.131:38009)
I20260810 04:11:14.740365 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 12753
I20260810 04:11:14.740468 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:14.740545 12386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:47313
I20260810 04:11:14.740684 11238 external_mini_cluster.cc:1428] Setting key 71a283debd5f0b3c725038490e10918e
I20260810 04:11:14.741557 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:11:14.746711 12894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.740530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41047 (local address 127.10.249.131:53127)
0810 04:11:14.740871 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.740882 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.740967 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.741111 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.741112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.741303 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:14.741359 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.741361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.742176 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.742177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.742690 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.742692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.743050 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.743051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.743118 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.743602 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:14.743608 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:14.743996 (+ 388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:14.745833 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.745834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.745834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.745993 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.746192 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:14.746193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:14.746193 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:14.746242 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:14.746495 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:14.746496 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:14.746528 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.746574 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.746645 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":67,"threads_started":1}
I20260810 04:11:14.746841 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.740534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:53127 (local address 127.10.249.190:41047)
0810 04:11:14.740579 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.740581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.740967 (+ 386us) server_negotiation.cc:407] Connection header received
0810 04:11:14.741038 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.741039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.741050 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.741091 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:14.741427 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.742072 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.742786 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.742986 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.743051 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.744074 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:14.744075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:14.744075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:14.744080 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:14.745715 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.746059 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.746060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.746060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.746118 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.746297 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.746298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.746298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.746428 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:14.746497 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.746609 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.746689 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:11:14 dist-test-slave-0kls krb5kdc[12340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:14.766831 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.759657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59352 (local address 127.10.249.190:41047)
0810 04:11:14.759696 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.759698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.759768 (+ 70us) server_negotiation.cc:407] Connection header received
0810 04:11:14.759858 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.759859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.759867 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.759920 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:14.760445 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.761018 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.761720 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.761944 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.761994 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.764216 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:14.764217 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:14.764218 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:14.764225 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:14.765603 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.766062 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.766063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.766064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.766122 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:14.766322 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:14.766323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:14.766324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:14.766433 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:14.766537 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.766652 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.766729 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:11:14.768554 12386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:14.770186 12386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:14.776444 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.772248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38009 (local address 127.0.0.1:43110)
0810 04:11:14.772403 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.772444 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.772509 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.772961 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.772964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.772966 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:14.773047 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.773050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.774290 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.774290 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.775259 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.775262 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.776095 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.776096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.776186 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.776199 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.776264 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.776340 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":1,"thread_start_us":49,"threads_started":1}
I20260810 04:11:14.776463 12906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.772496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50850 (local address 127.10.249.129:42205)
0810 04:11:14.772661 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.772667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.772742 (+ 75us) server_negotiation.cc:407] Connection header received
0810 04:11:14.772825 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.772828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.772844 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.772939 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:14.773137 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.773991 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.775483 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.775991 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.776027 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.776093 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.776294 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.776356 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260810 04:11:14.776695 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.772504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43110 (local address 127.10.249.131:38009)
0810 04:11:14.772759 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.772762 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.772771 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:14.772821 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.772823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.772836 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.773120 (+ 284us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:14.773181 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.774236 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.775321 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.776006 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.776080 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.776137 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.776560 (+ 423us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.776602 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":93,"threads_started":1}
I20260810 04:11:14.776692 12904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.772249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46527 (local address 127.0.0.1:59094)
0810 04:11:14.772601 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.772610 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.772644 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.772968 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.772969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.772970 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:14.773047 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.773049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.774226 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.774227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.775549 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.775551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.776440 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.776441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.776499 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.776503 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.776595 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.776629 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":70,"thread_start_us":55,"threads_started":1}
I20260810 04:11:14.776443 12902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.772262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:42205 (local address 127.0.0.1:50850)
0810 04:11:14.772680 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.772689 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.772742 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.773006 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.773007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.773009 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:14.773055 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.773057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.774090 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.774091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.775379 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.775382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.776159 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.776160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.776215 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.776217 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.776264 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.776340 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":44,"thread_start_us":50,"threads_started":1}
I20260810 04:11:14.776944 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.772402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59094 (local address 127.10.249.130:46527)
0810 04:11:14.772699 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.772703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.772714 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:11:14.772757 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.772759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.772775 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.772885 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:14.773122 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.774160 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.775608 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.776267 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.776347 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.776407 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.776828 (+ 421us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.776861 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":118,"threads_started":1}
I20260810 04:11:14.777352 12820 tablet_service.cc:1467] Processing CreateTablet for tablet 18cc3a9342ee4e67acf99a43b31a287d (DEFAULT_TABLE table=test-table [id=1b710655738b44b69367425e1a04c3d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:14.777513 12674 tablet_service.cc:1467] Processing CreateTablet for tablet 18cc3a9342ee4e67acf99a43b31a287d (DEFAULT_TABLE table=test-table [id=1b710655738b44b69367425e1a04c3d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:14.777511 12528 tablet_service.cc:1467] Processing CreateTablet for tablet 18cc3a9342ee4e67acf99a43b31a287d (DEFAULT_TABLE table=test-table [id=1b710655738b44b69367425e1a04c3d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:14.777721 12820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18cc3a9342ee4e67acf99a43b31a287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:14.777849 12674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18cc3a9342ee4e67acf99a43b31a287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:14.777849 12528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18cc3a9342ee4e67acf99a43b31a287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:14.780085 12908 tablet_bootstrap.cc:492] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: Bootstrap starting.
I20260810 04:11:14.780995 12908 tablet_bootstrap.cc:654] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:14.781381 12908 log.cc:824] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:14.781678 12910 tablet_bootstrap.cc:492] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: Bootstrap starting.
I20260810 04:11:14.781945 12909 tablet_bootstrap.cc:492] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Bootstrap starting.
I20260810 04:11:14.782317 12908 tablet_bootstrap.cc:492] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: No bootstrap required, opened a new log
I20260810 04:11:14.782346 12910 tablet_bootstrap.cc:654] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:14.782392 12908 ts_tablet_manager.cc:1397] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:14.782600 12909 tablet_bootstrap.cc:654] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:14.782682 12910 log.cc:824] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:14.782948 12909 log.cc:824] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:14.783324 12910 tablet_bootstrap.cc:492] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: No bootstrap required, opened a new log
I20260810 04:11:14.783403 12910 ts_tablet_manager.cc:1397] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:14.783630 12909 tablet_bootstrap.cc:492] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: No bootstrap required, opened a new log
I20260810 04:11:14.783685 12909 ts_tablet_manager.cc:1397] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:14.784065 12908 raft_consensus.cc:348] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.784209 12908 raft_consensus.cc:374] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:14.784240 12908 raft_consensus.cc:729] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8879baf9e44e428ca17843091d9fec42, State: Initialized, Role: FOLLOWER
I20260810 04:11:14.784350 12908 consensus_queue.cc:260] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.784581 12887 heartbeater.cc:503] Master 127.10.249.190:41047 was elected leader, sending a full tablet report...
I20260810 04:11:14.784572 12908 ts_tablet_manager.cc:1428] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:11:14.785184 12910 raft_consensus.cc:348] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.785320 12910 raft_consensus.cc:374] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:14.785352 12910 raft_consensus.cc:729] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1455dc15d604bc98e74d0c092f1c988, State: Initialized, Role: FOLLOWER
I20260810 04:11:14.785372 12909 raft_consensus.cc:348] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.785490 12909 raft_consensus.cc:374] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:14.785457 12910 consensus_queue.cc:260] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.785517 12909 raft_consensus.cc:729] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828d06632311462490afb959d13108da, State: Initialized, Role: FOLLOWER
I20260810 04:11:14.785619 12909 consensus_queue.cc:260] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.785705 12910 ts_tablet_manager.cc:1428] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:14.785712 12597 heartbeater.cc:503] Master 127.10.249.190:41047 was elected leader, sending a full tablet report...
I20260810 04:11:14.785867 12909 ts_tablet_manager.cc:1428] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:14.785931 12744 heartbeater.cc:503] Master 127.10.249.190:41047 was elected leader, sending a full tablet report...
W20260810 04:11:14.844713 12745 tablet.cc:2369] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:11:14.900313 12916 raft_consensus.cc:482] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:14.900426 12916 raft_consensus.cc:504] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.900774 12916 leader_election.cc:288] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8879baf9e44e428ca17843091d9fec42 (127.10.249.131:38009), a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205)
I20260810 04:11:14.903674 12906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.901121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:40629 (local address 127.10.249.129:42205)
0810 04:11:14.901181 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.901183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.901275 (+ 92us) server_negotiation.cc:407] Connection header received
0810 04:11:14.901307 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.901308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.901317 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.901373 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:14.901537 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.902099 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.903051 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.903353 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.903401 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.903408 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.903566 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.903609 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:11:14.903705 12630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.901009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38009 (local address 127.10.249.130:59023)
0810 04:11:14.901073 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.901083 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.901126 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.901290 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.901291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.901293 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:14.901365 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.901367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.902111 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.902112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.902963 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.902965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.903457 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.903457 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.903545 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.903549 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.903600 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.903626 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":36}
I20260810 04:11:14.903723 12917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.901022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:42205 (local address 127.10.249.130:40629)
0810 04:11:14.901199 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:14.901208 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:14.901265 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:14.901387 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:14.901388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:14.901389 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:14.901475 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.901476 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.902188 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.902189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.902964 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:14.902966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.903431 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.903432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:14.903501 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.903504 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:14.903541 (+ 37us) client_negotiation.cc:240] Negotiation successful
0810 04:11:14.903568 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":3,"thread_start_us":98,"threads_started":1}
I20260810 04:11:14.903713 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.901094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:59023 (local address 127.10.249.131:38009)
0810 04:11:14.901149 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.901151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.901161 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:14.901201 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.901202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.901213 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.901272 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:14.901441 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.902031 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.903048 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.903366 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.903446 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.903454 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.903619 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.903657 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:11:14.904094 12549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18cc3a9342ee4e67acf99a43b31a287d" candidate_uuid: "828d06632311462490afb959d13108da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1455dc15d604bc98e74d0c092f1c988" is_pre_election: true
I20260810 04:11:14.904201 12840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18cc3a9342ee4e67acf99a43b31a287d" candidate_uuid: "828d06632311462490afb959d13108da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8879baf9e44e428ca17843091d9fec42" is_pre_election: true
I20260810 04:11:14.904256 12549 raft_consensus.cc:2454] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828d06632311462490afb959d13108da in term 0.
I20260810 04:11:14.904346 12840 raft_consensus.cc:2454] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828d06632311462490afb959d13108da in term 0.
I20260810 04:11:14.904511 12622 leader_election.cc:302] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 828d06632311462490afb959d13108da, a1455dc15d604bc98e74d0c092f1c988; no voters:
I20260810 04:11:14.904681 12916 raft_consensus.cc:2781] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:14.904739 12916 raft_consensus.cc:482] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:14.904762 12916 raft_consensus.cc:3037] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:14.905720 12916 raft_consensus.cc:504] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.905882 12916 leader_election.cc:288] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [CANDIDATE]: Term 1 election: Requested vote from peers 8879baf9e44e428ca17843091d9fec42 (127.10.249.131:38009), a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205)
I20260810 04:11:14.906024 12840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18cc3a9342ee4e67acf99a43b31a287d" candidate_uuid: "828d06632311462490afb959d13108da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8879baf9e44e428ca17843091d9fec42"
I20260810 04:11:14.906064 12549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18cc3a9342ee4e67acf99a43b31a287d" candidate_uuid: "828d06632311462490afb959d13108da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1455dc15d604bc98e74d0c092f1c988"
I20260810 04:11:14.906097 12840 raft_consensus.cc:3037] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:14.906165 12549 raft_consensus.cc:3037] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:14.906859 12840 raft_consensus.cc:2454] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828d06632311462490afb959d13108da in term 1.
I20260810 04:11:14.906872 12549 raft_consensus.cc:2454] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828d06632311462490afb959d13108da in term 1.
I20260810 04:11:14.907043 12623 leader_election.cc:302] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 828d06632311462490afb959d13108da, 8879baf9e44e428ca17843091d9fec42; no voters:
I20260810 04:11:14.907181 12916 raft_consensus.cc:2781] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:14.907364 12916 raft_consensus.cc:686] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 1 LEADER]: Becoming Leader. State: Replica: 828d06632311462490afb959d13108da, State: Running, Role: LEADER
I20260810 04:11:14.907461 12916 consensus_queue.cc:237] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } }
I20260810 04:11:14.908272 12385 catalog_manager.cc:5495] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da reported cstate change: term changed from 0 to 1, leader changed from <none> to 828d06632311462490afb959d13108da (127.10.249.130). New cstate: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260810 04:11:14.924610 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:14.922354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59104 (local address 127.10.249.130:46527)
0810 04:11:14.922420 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:14.922422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:14.922431 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:14.922459 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:14.922460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:14.922491 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:14.922565 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:14.922783 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.923232 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.923959 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:14.924129 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:14.924182 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:14.924348 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:14.924432 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:14.924486 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:14.924525 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 04:11:14.924541 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:11:14.926290 12549 raft_consensus.cc:1261] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Refusing update from remote peer 828d06632311462490afb959d13108da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:14.926290 12840 raft_consensus.cc:1261] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Refusing update from remote peer 828d06632311462490afb959d13108da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:14.926636 12916 consensus_queue.cc:1035] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [LEADER]: Connected to new peer: Peer: permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:14.926798 12918 consensus_queue.cc:1035] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:14.929023 12921 mvcc.cc:205] Tried to move back new op lower bound from 7316828466895564800 to 7316828466821447680. Current Snapshot: MvccSnapshot[applied={T|T < 7316828466895564800}]
I20260810 04:11:14.929280 12922 mvcc.cc:205] Tried to move back new op lower bound from 7316828466895564800 to 7316828466821447680. Current Snapshot: MvccSnapshot[applied={T|T < 7316828466895564800}]
I20260810 04:11:14.929685 12923 mvcc.cc:205] Tried to move back new op lower bound from 7316828466895564800 to 7316828466821447680. Current Snapshot: MvccSnapshot[applied={T|T < 7316828466895564800}]
I20260810 04:11:14.933187 12385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:14.933324 12385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:14.934180 12385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e: Sending DeleteTablet for 3 replicas of tablet 18cc3a9342ee4e67acf99a43b31a287d
I20260810 04:11:14.934520 12820 tablet_service.cc:1514] Processing DeleteTablet for tablet 18cc3a9342ee4e67acf99a43b31a287d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:14 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:43110
I20260810 04:11:14.934615 12674 tablet_service.cc:1514] Processing DeleteTablet for tablet 18cc3a9342ee4e67acf99a43b31a287d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:14 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:59094
I20260810 04:11:14.934739 12528 tablet_service.cc:1514] Processing DeleteTablet for tablet 18cc3a9342ee4e67acf99a43b31a287d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:14 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:50850
I20260810 04:11:14.934799 12931 tablet_replica.cc:330] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: stopping tablet replica
I20260810 04:11:14.934846 12932 tablet_replica.cc:330] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: stopping tablet replica
I20260810 04:11:14.934934 12932 raft_consensus.cc:2229] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:11:14.935061 12932 raft_consensus.cc:2258] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:14.935057 12931 raft_consensus.cc:2229] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:14.935249 12933 tablet_replica.cc:330] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: stopping tablet replica
I20260810 04:11:14.935343 12933 raft_consensus.cc:2229] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:14.935298 12385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:14.935431 12385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:14.935451 12933 raft_consensus.cc:2258] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:14.935370 12931 raft_consensus.cc:2258] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:14.935916 12933 ts_tablet_manager.cc:1905] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:14.936780 12674 tablet_service.cc:1467] Processing CreateTablet for tablet 1e284939291c4dea9afde41cfed35359 (DEFAULT_TABLE table=test-table [id=8b0087ff81ac4b96ad0022412cd6c98a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:14.936789 12528 tablet_service.cc:1467] Processing CreateTablet for tablet 1e284939291c4dea9afde41cfed35359 (DEFAULT_TABLE table=test-table [id=8b0087ff81ac4b96ad0022412cd6c98a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:14.936895 12528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e284939291c4dea9afde41cfed35359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:14.936899 12674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e284939291c4dea9afde41cfed35359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:14.938098 12933 ts_tablet_manager.cc:1918] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:14.938164 12933 log.cc:1196] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/18cc3a9342ee4e67acf99a43b31a287d
I20260810 04:11:14.938297 12909 tablet_bootstrap.cc:492] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: Bootstrap starting.
I20260810 04:11:14.938444 12933 ts_tablet_manager.cc:1939] T 18cc3a9342ee4e67acf99a43b31a287d P a1455dc15d604bc98e74d0c092f1c988: Deleting consensus metadata
I20260810 04:11:14.938745 12909 tablet_bootstrap.cc:654] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:14.938859 12370 catalog_manager.cc:4841] TS a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205): tablet 18cc3a9342ee4e67acf99a43b31a287d (table test-table [id=1b710655738b44b69367425e1a04c3d8]) successfully deleted
I20260810 04:11:14.939061 12910 tablet_bootstrap.cc:492] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: Bootstrap starting.
I20260810 04:11:14.939424 12909 tablet_bootstrap.cc:492] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: No bootstrap required, opened a new log
I20260810 04:11:14.939476 12909 ts_tablet_manager.cc:1397] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:14.939487 12910 tablet_bootstrap.cc:654] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:14.939626 12909 raft_consensus.cc:348] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:14.939702 12909 raft_consensus.cc:374] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:14.939730 12909 raft_consensus.cc:729] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828d06632311462490afb959d13108da, State: Initialized, Role: FOLLOWER
I20260810 04:11:14.939786 12909 consensus_queue.cc:260] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:14.939880 12909 ts_tablet_manager.cc:1428] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:14.940517 12820 tablet_service.cc:1467] Processing CreateTablet for tablet 1e284939291c4dea9afde41cfed35359 (DEFAULT_TABLE table=test-table [id=8b0087ff81ac4b96ad0022412cd6c98a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:14.940582 12932 ts_tablet_manager.cc:1905] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:14.940636 12820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e284939291c4dea9afde41cfed35359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:14.940891 12931 ts_tablet_manager.cc:1905] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:14.941728 12908 tablet_bootstrap.cc:492] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: Bootstrap starting.
I20260810 04:11:14.942126 12908 tablet_bootstrap.cc:654] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:14.942803 12908 tablet_bootstrap.cc:492] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: No bootstrap required, opened a new log
I20260810 04:11:14.942878 12908 ts_tablet_manager.cc:1397] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:14.943030 12908 raft_consensus.cc:348] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:14.943106 12908 raft_consensus.cc:374] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:14.943135 12908 raft_consensus.cc:729] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8879baf9e44e428ca17843091d9fec42, State: Initialized, Role: FOLLOWER
I20260810 04:11:14.943188 12908 consensus_queue.cc:260] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:14.943274 12908 ts_tablet_manager.cc:1428] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:14.943290 12932 ts_tablet_manager.cc:1918] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:14.943364 12932 log.cc:1196] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/18cc3a9342ee4e67acf99a43b31a287d
I20260810 04:11:14.943608 12932 ts_tablet_manager.cc:1939] T 18cc3a9342ee4e67acf99a43b31a287d P 828d06632311462490afb959d13108da: Deleting consensus metadata
I20260810 04:11:14.943996 12372 catalog_manager.cc:4841] TS 828d06632311462490afb959d13108da (127.10.249.130:46527): tablet 18cc3a9342ee4e67acf99a43b31a287d (table test-table [id=1b710655738b44b69367425e1a04c3d8]) successfully deleted
I20260810 04:11:14.944607 12931 ts_tablet_manager.cc:1918] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:14.944689 12931 log.cc:1196] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/18cc3a9342ee4e67acf99a43b31a287d
I20260810 04:11:14.944947 12931 ts_tablet_manager.cc:1939] T 18cc3a9342ee4e67acf99a43b31a287d P 8879baf9e44e428ca17843091d9fec42: Deleting consensus metadata
I20260810 04:11:14.945395 12371 catalog_manager.cc:4841] TS 8879baf9e44e428ca17843091d9fec42 (127.10.249.131:38009): tablet 18cc3a9342ee4e67acf99a43b31a287d (table test-table [id=1b710655738b44b69367425e1a04c3d8]) successfully deleted
I20260810 04:11:14.945600 12910 tablet_bootstrap.cc:492] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: No bootstrap required, opened a new log
I20260810 04:11:14.945655 12910 ts_tablet_manager.cc:1397] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260810 04:11:14.945856 12910 raft_consensus.cc:348] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:14.945932 12910 raft_consensus.cc:374] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:14.945951 12910 raft_consensus.cc:729] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1455dc15d604bc98e74d0c092f1c988, State: Initialized, Role: FOLLOWER
I20260810 04:11:14.945997 12910 consensus_queue.cc:260] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:14.946086 12910 ts_tablet_manager.cc:1428] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260810 04:11:14.961752 12598 tablet.cc:2369] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:11:14.987524 12888 tablet.cc:2369] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:11:15.021198 12914 raft_consensus.cc:482] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:15.021296 12914 raft_consensus.cc:504] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.021616 12914 leader_election.cc:288] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205), 828d06632311462490afb959d13108da (127.10.249.130:46527)
I20260810 04:11:15.025360 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.022357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:39265 (local address 127.10.249.130:46527)
0810 04:11:15.022401 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.022403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.022509 (+ 106us) server_negotiation.cc:407] Connection header received
0810 04:11:15.022596 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.022597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.022607 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.022634 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:15.022903 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.023543 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.024695 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.025008 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.025095 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.025105 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.025259 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.025292 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:11:15.025461 12777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.021905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:42205 (local address 127.10.249.131:45507)
0810 04:11:15.021978 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:15.021990 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:15.022072 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:15.022296 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:15.022297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:15.022299 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:15.022374 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.022376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.023316 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.023317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.024454 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.024457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.025198 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.025199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.025279 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.025283 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:15.025330 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 04:11:15.025369 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 04:11:15.025377 12938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.021941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46527 (local address 127.10.249.131:39265)
0810 04:11:15.022449 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:15.022460 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:15.022530 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:15.022760 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:15.022760 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:15.022762 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:15.022834 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.022835 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.023630 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.023630 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.024618 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.024619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.025117 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.025118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.025190 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.025193 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:15.025252 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 04:11:15.025290 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":54,"threads_started":1}
I20260810 04:11:15.025802 12695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e284939291c4dea9afde41cfed35359" candidate_uuid: "8879baf9e44e428ca17843091d9fec42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828d06632311462490afb959d13108da" is_pre_election: true
I20260810 04:11:15.025894 12906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.022055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:45507 (local address 127.10.249.129:42205)
0810 04:11:15.022100 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.022102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.022112 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:15.022157 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.022158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.022171 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.022234 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:15.022463 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.023233 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.024552 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.025076 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.025150 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.025160 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.025770 (+ 610us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.025838 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:11:15.025941 12695 raft_consensus.cc:2454] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8879baf9e44e428ca17843091d9fec42 in term 0.
I20260810 04:11:15.026055 12549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e284939291c4dea9afde41cfed35359" candidate_uuid: "8879baf9e44e428ca17843091d9fec42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1455dc15d604bc98e74d0c092f1c988" is_pre_election: true
I20260810 04:11:15.026135 12549 raft_consensus.cc:2454] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8879baf9e44e428ca17843091d9fec42 in term 0.
I20260810 04:11:15.026127 12771 leader_election.cc:302] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 828d06632311462490afb959d13108da, 8879baf9e44e428ca17843091d9fec42; no voters:
I20260810 04:11:15.026249 12914 raft_consensus.cc:2781] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:15.026289 12914 raft_consensus.cc:482] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:15.026311 12914 raft_consensus.cc:3037] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:15.026950 12914 raft_consensus.cc:504] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.027087 12914 leader_election.cc:288] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [CANDIDATE]: Term 1 election: Requested vote from peers a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205), 828d06632311462490afb959d13108da (127.10.249.130:46527)
I20260810 04:11:15.027272 12549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e284939291c4dea9afde41cfed35359" candidate_uuid: "8879baf9e44e428ca17843091d9fec42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1455dc15d604bc98e74d0c092f1c988"
I20260810 04:11:15.027375 12549 raft_consensus.cc:3037] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:15.027390 12695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e284939291c4dea9afde41cfed35359" candidate_uuid: "8879baf9e44e428ca17843091d9fec42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828d06632311462490afb959d13108da"
I20260810 04:11:15.027477 12695 raft_consensus.cc:3037] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:15.028118 12695 raft_consensus.cc:2454] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8879baf9e44e428ca17843091d9fec42 in term 1.
I20260810 04:11:15.028151 12549 raft_consensus.cc:2454] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8879baf9e44e428ca17843091d9fec42 in term 1.
I20260810 04:11:15.028280 12771 leader_election.cc:302] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 828d06632311462490afb959d13108da, 8879baf9e44e428ca17843091d9fec42; no voters:
I20260810 04:11:15.028376 12914 raft_consensus.cc:2781] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:15.028549 12914 raft_consensus.cc:686] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 1 LEADER]: Becoming Leader. State: Replica: 8879baf9e44e428ca17843091d9fec42, State: Running, Role: LEADER
I20260810 04:11:15.028651 12914 consensus_queue.cc:237] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.029331 12386 catalog_manager.cc:5495] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8879baf9e44e428ca17843091d9fec42 (127.10.249.131). New cstate: current_term: 1 leader_uuid: "8879baf9e44e428ca17843091d9fec42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } health_report { overall_health: HEALTHY } } }
Aug 10 04:11:15 dist-test-slave-0kls krb5kdc[12340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:15.060932 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.054395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41047 (local address 127.0.0.1:59364)
0810 04:11:15.054578 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:15.054589 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:15.054660 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:15.054789 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:15.054790 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:15.055106 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:15.055152 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.055154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.055680 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.055680 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.056152 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.056153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.056424 (+ 271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.056424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.056470 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.056922 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:15.056927 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:15.058347 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:15.059852 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:15.059860 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:15.059870 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:15.060052 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:15.060257 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:15.060258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:15.060258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:15.060311 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:15.060542 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:15.060550 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:15.060593 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 04:11:15.060678 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 04:11:15.060800 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":3,"thread_start_us":97,"threads_started":1}
I20260810 04:11:15.060942 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.054459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59364 (local address 127.10.249.190:41047)
0810 04:11:15.054526 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.054528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.054663 (+ 135us) server_negotiation.cc:407] Connection header received
0810 04:11:15.054704 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.054705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.054713 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.054761 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:15.055213 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.055615 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.056217 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.056364 (+ 147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.056404 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.058429 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:15.058430 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:15.058431 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:15.058437 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:15.059709 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:15.060132 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:15.060133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:15.060133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:15.060189 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:15.060374 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:15.060375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:15.060375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:15.060478 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:15.060553 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.060700 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.060860 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":41}
I20260810 04:11:15.063086 12386 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:59364:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 04:11:15.063308 12386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:15.064693 12528 tablet_service.cc:1467] Processing CreateTablet for tablet 87b66cb9d5634c8682b87a1c9a510771 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a99ed49cfe8a42609cc1f9b22aaf5f7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:11:15.064694 12674 tablet_service.cc:1467] Processing CreateTablet for tablet 87b66cb9d5634c8682b87a1c9a510771 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a99ed49cfe8a42609cc1f9b22aaf5f7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:11:15.064851 12528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b66cb9d5634c8682b87a1c9a510771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:15.064865 12674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b66cb9d5634c8682b87a1c9a510771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:15.066023 12909 tablet_bootstrap.cc:492] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: Bootstrap starting.
I20260810 04:11:15.066108 12820 tablet_service.cc:1467] Processing CreateTablet for tablet 87b66cb9d5634c8682b87a1c9a510771 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a99ed49cfe8a42609cc1f9b22aaf5f7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:11:15.066260 12820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b66cb9d5634c8682b87a1c9a510771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:15.066413 12909 tablet_bootstrap.cc:654] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:15.066689 12910 tablet_bootstrap.cc:492] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: Bootstrap starting.
I20260810 04:11:15.066965 12909 tablet_bootstrap.cc:492] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: No bootstrap required, opened a new log
I20260810 04:11:15.067019 12909 ts_tablet_manager.cc:1397] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:15.067095 12910 tablet_bootstrap.cc:654] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:15.067107 12909 raft_consensus.cc:348] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.067175 12909 raft_consensus.cc:374] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:15.067200 12909 raft_consensus.cc:729] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828d06632311462490afb959d13108da, State: Initialized, Role: FOLLOWER
I20260810 04:11:15.067242 12909 consensus_queue.cc:260] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.067332 12909 ts_tablet_manager.cc:1428] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:15.067359 12926 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.067454 12926 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:15.067610 12908 tablet_bootstrap.cc:492] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: Bootstrap starting.
I20260810 04:11:15.067901 12910 tablet_bootstrap.cc:492] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: No bootstrap required, opened a new log
I20260810 04:11:15.067970 12910 ts_tablet_manager.cc:1397] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:15.068064 12908 tablet_bootstrap.cc:654] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:15.068152 12910 raft_consensus.cc:348] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.068241 12910 raft_consensus.cc:374] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:15.068272 12910 raft_consensus.cc:729] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1455dc15d604bc98e74d0c092f1c988, State: Initialized, Role: FOLLOWER
I20260810 04:11:15.068338 12910 consensus_queue.cc:260] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.068444 12910 ts_tablet_manager.cc:1428] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:15.068499 12915 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.068607 12915 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:15.068667 12926 raft_consensus.cc:482] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:15.068717 12926 raft_consensus.cc:504] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.068848 12926 leader_election.cc:288] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205), 8879baf9e44e428ca17843091d9fec42 (127.10.249.131:38009)
I20260810 04:11:15.068913 12908 tablet_bootstrap.cc:492] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: No bootstrap required, opened a new log
I20260810 04:11:15.068955 12908 ts_tablet_manager.cc:1397] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:15.068996 12549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87b66cb9d5634c8682b87a1c9a510771" candidate_uuid: "828d06632311462490afb959d13108da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1455dc15d604bc98e74d0c092f1c988" is_pre_election: true
I20260810 04:11:15.069061 12549 raft_consensus.cc:2454] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828d06632311462490afb959d13108da in term 0.
I20260810 04:11:15.069087 12908 raft_consensus.cc:348] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.069151 12908 raft_consensus.cc:374] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:15.069167 12908 raft_consensus.cc:729] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8879baf9e44e428ca17843091d9fec42, State: Initialized, Role: FOLLOWER
I20260810 04:11:15.069195 12622 leader_election.cc:302] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 828d06632311462490afb959d13108da, a1455dc15d604bc98e74d0c092f1c988; no voters:
I20260810 04:11:15.069199 12908 consensus_queue.cc:260] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.069273 12926 raft_consensus.cc:2781] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:15.069298 12908 ts_tablet_manager.cc:1428] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:15.069305 12926 raft_consensus.cc:482] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:15.069329 12926 raft_consensus.cc:3037] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:15.069443 12914 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.069509 12914 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:15.069584 12840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87b66cb9d5634c8682b87a1c9a510771" candidate_uuid: "828d06632311462490afb959d13108da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8879baf9e44e428ca17843091d9fec42" is_pre_election: true
I20260810 04:11:15.069638 12840 raft_consensus.cc:2454] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828d06632311462490afb959d13108da in term 0.
I20260810 04:11:15.070181 12926 raft_consensus.cc:504] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.070326 12926 leader_election.cc:288] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [CANDIDATE]: Term 1 election: Requested vote from peers a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205), 8879baf9e44e428ca17843091d9fec42 (127.10.249.131:38009)
I20260810 04:11:15.070442 12549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87b66cb9d5634c8682b87a1c9a510771" candidate_uuid: "828d06632311462490afb959d13108da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1455dc15d604bc98e74d0c092f1c988"
I20260810 04:11:15.070485 12840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87b66cb9d5634c8682b87a1c9a510771" candidate_uuid: "828d06632311462490afb959d13108da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8879baf9e44e428ca17843091d9fec42"
I20260810 04:11:15.070538 12549 raft_consensus.cc:3037] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:15.070551 12840 raft_consensus.cc:3037] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:15.071311 12549 raft_consensus.cc:2454] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828d06632311462490afb959d13108da in term 1.
I20260810 04:11:15.071483 12622 leader_election.cc:302] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 828d06632311462490afb959d13108da, a1455dc15d604bc98e74d0c092f1c988; no voters:
I20260810 04:11:15.071575 12926 raft_consensus.cc:2781] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:15.071586 12840 raft_consensus.cc:2454] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828d06632311462490afb959d13108da in term 1.
I20260810 04:11:15.071624 12926 raft_consensus.cc:686] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [term 1 LEADER]: Becoming Leader. State: Replica: 828d06632311462490afb959d13108da, State: Running, Role: LEADER
I20260810 04:11:15.071691 12926 consensus_queue.cc:237] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } }
I20260810 04:11:15.071979 12918 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: TxnStatusTablet state changed. Reason: New leader 828d06632311462490afb959d13108da. Latest consensus state: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.072069 12918 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:11:15.072172 12385 catalog_manager.cc:5495] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da reported cstate change: term changed from 0 to 1, leader changed from <none> to 828d06632311462490afb959d13108da (127.10.249.130). New cstate: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260810 04:11:15.072314 12952 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 04:11:15.072427 12952 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 04:11:15.079131 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.076774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46527 (local address 127.0.0.1:59112)
0810 04:11:15.076845 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:15.076857 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:15.076901 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:15.077047 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:15.077047 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:15.077048 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:15.077082 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.077084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.077888 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.077889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.078380 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.078382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.078787 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.078787 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.078828 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.078841 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:15.079018 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:15.079024 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:11:15.079052 (+ 28us) client_negotiation.cc:240] Negotiation successful
0810 04:11:15.079085 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 04:11:15.079144 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.076842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59112 (local address 127.10.249.130:46527)
0810 04:11:15.076887 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.076889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.076899 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:15.076959 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.076960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.076971 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.077045 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:15.077119 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.077783 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.078459 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.078706 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.078774 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.078911 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:15.078946 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:15.079010 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.079058 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.079080 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:11:15.080145 12549 raft_consensus.cc:1261] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Refusing update from remote peer 828d06632311462490afb959d13108da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:15.080312 12840 raft_consensus.cc:1261] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Refusing update from remote peer 828d06632311462490afb959d13108da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:15.080356 12918 consensus_queue.cc:1035] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:15.080637 12918 consensus_queue.cc:1035] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da [LEADER]: Connected to new peer: Peer: permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:15.080850 12915 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: TxnStatusTablet state changed. Reason: New leader 828d06632311462490afb959d13108da. Latest consensus state: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.080955 12915 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:15.081650 12914 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: TxnStatusTablet state changed. Reason: New leader 828d06632311462490afb959d13108da. Latest consensus state: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.081763 12914 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:15.082161 12926 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.082240 12926 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:11:15.082623 12915 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.082707 12915 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P a1455dc15d604bc98e74d0c092f1c988: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:15.083209 12916 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.083287 12916 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P 828d06632311462490afb959d13108da: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:11:15.083599 12914 tablet_replica.cc:439] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "828d06632311462490afb959d13108da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 } } peers { permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 } } peers { permanent_uuid: "8879baf9e44e428ca17843091d9fec42" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38009 } } }
I20260810 04:11:15.083674 12914 tablet_replica.cc:442] T 87b66cb9d5634c8682b87a1c9a510771 P 8879baf9e44e428ca17843091d9fec42: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:15.087230 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.085057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43116 (local address 127.10.249.131:38009)
0810 04:11:15.085089 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.085091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.085130 (+ 39us) server_negotiation.cc:407] Connection header received
0810 04:11:15.085209 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.085210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.085223 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.085272 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:15.085376 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.085747 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.086641 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.086802 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.086845 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.086991 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:15.087070 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:15.087110 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.087174 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.087190 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:11:15.091773 12894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.089366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46527 (local address 127.10.249.131:42431)
0810 04:11:15.089459 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:15.089471 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:15.089517 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:15.089701 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:15.089702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:15.089703 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:15.089746 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.089747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.090601 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.090602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.091050 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.091052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.091438 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.091439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.091478 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.091488 (+ 10us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:15.091649 (+ 161us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:15.091650 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:11:15.091699 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 04:11:15.091728 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 04:11:15.091810 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.089415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:42431 (local address 127.10.249.130:46527)
0810 04:11:15.089593 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.089595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.089603 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:15.089622 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.089623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.089635 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.089690 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:15.089878 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.090529 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.091125 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.091366 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.091425 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.091561 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:15.091590 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:15.091644 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.091709 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.091734 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260810 04:11:15.094318 12549 raft_consensus.cc:1261] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Refusing update from remote peer 8879baf9e44e428ca17843091d9fec42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:15.094340 12695 raft_consensus.cc:1261] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Refusing update from remote peer 8879baf9e44e428ca17843091d9fec42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:15.094563 12939 consensus_queue.cc:1035] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1455dc15d604bc98e74d0c092f1c988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:15.094705 12914 consensus_queue.cc:1035] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828d06632311462490afb959d13108da" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:15.103334 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.100513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:40287 (local address 127.10.249.131:38009)
0810 04:11:15.100557 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.100559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.100571 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:11:15.100632 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.100633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.100645 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.100711 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:15.100992 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.101554 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.102617 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.102793 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.102844 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.103090 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:15.103121 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:15.103163 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.103235 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.103256 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:11:15.103353 12750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.100419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38009 (local address 127.10.249.130:40287)
0810 04:11:15.100532 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:15.100542 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:15.100579 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:15.100846 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:15.100847 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:15.100849 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:15.100915 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.100917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.101613 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.101614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.102529 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:15.102533 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.102880 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.102881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:15.102959 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.102974 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:15.103184 (+ 210us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:15.103185 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:11:15.103230 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 04:11:15.103269 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260810 04:11:15.110342 12386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:15.110423 12386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:15.110998 12386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 911c2c2b49f04176ad9d12168855fe9e: Sending DeleteTablet for 3 replicas of tablet 1e284939291c4dea9afde41cfed35359
I20260810 04:11:15.111217 12674 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e284939291c4dea9afde41cfed35359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:15 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:59094
I20260810 04:11:15.111233 12528 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e284939291c4dea9afde41cfed35359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:15 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:50850
I20260810 04:11:15.111297 12932 tablet_replica.cc:330] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: stopping tablet replica
I20260810 04:11:15.111308 12933 tablet_replica.cc:330] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: stopping tablet replica
I20260810 04:11:15.111343 12933 raft_consensus.cc:2229] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:15.111338 12932 raft_consensus.cc:2229] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:15.111370 12932 raft_consensus.cc:2258] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:15.111382 12933 raft_consensus.cc:2258] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:15.111716 12933 ts_tablet_manager.cc:1905] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:15.111850 12820 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e284939291c4dea9afde41cfed35359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:15 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:43110
I20260810 04:11:15.111943 12931 tablet_replica.cc:330] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: stopping tablet replica
I20260810 04:11:15.111996 12931 raft_consensus.cc:2229] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:11:15.112077 12931 raft_consensus.cc:2258] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:15.112330 12931 ts_tablet_manager.cc:1905] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:15.112586 12932 ts_tablet_manager.cc:1905] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:15.113736 12931 ts_tablet_manager.cc:1918] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:15.113834 12931 log.cc:1196] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/1e284939291c4dea9afde41cfed35359
I20260810 04:11:15.114064 12931 ts_tablet_manager.cc:1939] T 1e284939291c4dea9afde41cfed35359 P 8879baf9e44e428ca17843091d9fec42: Deleting consensus metadata
I20260810 04:11:15.114197 12932 ts_tablet_manager.cc:1918] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:15.114257 12932 log.cc:1196] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/1e284939291c4dea9afde41cfed35359
I20260810 04:11:15.114477 12932 ts_tablet_manager.cc:1939] T 1e284939291c4dea9afde41cfed35359 P 828d06632311462490afb959d13108da: Deleting consensus metadata
I20260810 04:11:15.114764 12372 catalog_manager.cc:4841] TS 828d06632311462490afb959d13108da (127.10.249.130:46527): tablet 1e284939291c4dea9afde41cfed35359 (table test-table [id=8b0087ff81ac4b96ad0022412cd6c98a]) successfully deleted
I20260810 04:11:15.114809 12933 ts_tablet_manager.cc:1918] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:15.114866 12933 log.cc:1196] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/1e284939291c4dea9afde41cfed35359
I20260810 04:11:15.115077 12933 ts_tablet_manager.cc:1939] T 1e284939291c4dea9afde41cfed35359 P a1455dc15d604bc98e74d0c092f1c988: Deleting consensus metadata
I20260810 04:11:15.115358 12370 catalog_manager.cc:4841] TS a1455dc15d604bc98e74d0c092f1c988 (127.10.249.129:42205): tablet 1e284939291c4dea9afde41cfed35359 (table test-table [id=8b0087ff81ac4b96ad0022412cd6c98a]) successfully deleted
I20260810 04:11:15.115470 12371 catalog_manager.cc:4841] TS 8879baf9e44e428ca17843091d9fec42 (127.10.249.131:38009): tablet 1e284939291c4dea9afde41cfed35359 (table test-table [id=8b0087ff81ac4b96ad0022412cd6c98a]) successfully deleted
Aug 10 04:11:15 dist-test-slave-0kls krb5kdc[12340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335074, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:15.127097 12906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.115783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50858 (local address 127.10.249.129:42205)
0810 04:11:15.115823 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.115825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.117962 (+ 2137us) server_negotiation.cc:407] Connection header received
0810 04:11:15.118008 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.118009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.118019 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.118075 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:15.118731 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.119416 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.120406 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.120698 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.120767 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.124210 (+ 3443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:15.124218 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:15.124218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:15.124225 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:15.125924 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:15.126295 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:15.126298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:15.126299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:15.126372 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:15.126571 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:15.126571 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:15.126572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:15.126718 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:15.126851 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.126924 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.127015 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:11:15.127389 12591 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50858
I20260810 04:11:15.135995 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:15.128198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59374 (local address 127.10.249.190:41047)
0810 04:11:15.128233 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:15.128234 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:15.128429 (+ 195us) server_negotiation.cc:407] Connection header received
0810 04:11:15.128457 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:15.128458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:15.128468 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:15.128520 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:15.129031 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.129682 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.130579 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:15.130841 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:15.130897 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:15.132198 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:15.132199 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:15.132199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:15.132225 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:15.133778 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:15.135320 (+ 1542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:15.135321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:15.135321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:15.135375 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:15.135559 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:15.135560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:15.135560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:15.135671 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:15.135756 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:15.135850 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 04:11:15.135916 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:11:15.136258 12386 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59374
I20260810 04:11:15.137024 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 12461
I20260810 04:11:15.148159 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 12606
I20260810 04:11:15.156661 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 12753
I20260810 04:11:15.162032 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 12353
2026-08-10T04:11:15Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2112 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:15 dist-test-slave-0kls krb5kdc[12970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:15 dist-test-slave-0kls krb5kdc[12970](info): set up 2 sockets
Aug 10 04:11:15 dist-test-slave-0kls krb5kdc[12970](info): commencing operation
krb5kdc: starting...
W20260810 04:11:16.154881 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.971s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:16.273581 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:46653
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:35573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:46653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:16.349295 12983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:16.349478 12983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:16.349498 12983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:16.350659 12983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:16.350700 12983 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 04:11:16.350713 12983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:16.350726 12983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:16.350781 12983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:16.350798 12983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:16.352596 12983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:35573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:46653
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:46653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:16.352851 12983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:16.353084 12983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:16.357888 12991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:16.357898 12989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:16.357923 12988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:16.357941 12983 server_base.cc:1034] running on GCE node
I20260810 04:11:16.358301 12983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:16.358597 12983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:16.359737 12983 hybrid_clock.cc:648] HybridClock initialized: now 1786335076359734 us; error 33 us; skew 500 ppm
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:16.362166 12983 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:16.362635 12983 webserver.cc:460] Webserver started at http://127.10.249.190:38931/ using document root <none> and password file <none>
I20260810 04:11:16.362890 12983 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:16.362936 12983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:16.363114 12983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:16.364053 12983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "ba601218a7d84fe1a8fa93c8865cbd59"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "fee756aefddf7adb163af336a82d22e3"
server_key_iv: "e038096062a3fa2cc6aaa3f527e49ed9"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.364401 12983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "ba601218a7d84fe1a8fa93c8865cbd59"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "fee756aefddf7adb163af336a82d22e3"
server_key_iv: "e038096062a3fa2cc6aaa3f527e49ed9"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.365624 12983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:11:16.366403 12998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.366575 12983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.366689 12983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "ba601218a7d84fe1a8fa93c8865cbd59"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "fee756aefddf7adb163af336a82d22e3"
server_key_iv: "e038096062a3fa2cc6aaa3f527e49ed9"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.366775 12983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:16.383381 12983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:16.385026 12983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:16.385170 12983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:16.389465 12983 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:46653
I20260810 04:11:16.389536 13062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:46653 every 8 connection(s)
I20260810 04:11:16.389868 12983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:16.390486 13063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:16.392503 13063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: Bootstrap starting.
I20260810 04:11:16.393028 13063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:16.393251 13063 log.cc:824] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:16.393896 13063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: No bootstrap required, opened a new log
I20260810 04:11:16.395912 13063 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba601218a7d84fe1a8fa93c8865cbd59" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46653 } }
I20260810 04:11:16.396034 13063 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:16.396054 13063 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba601218a7d84fe1a8fa93c8865cbd59, State: Initialized, Role: FOLLOWER
I20260810 04:11:16.396152 13063 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba601218a7d84fe1a8fa93c8865cbd59" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46653 } }
I20260810 04:11:16.396199 13063 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:16.396217 13063 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:16.396246 13063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:16.396672 13063 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba601218a7d84fe1a8fa93c8865cbd59" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46653 } }
I20260810 04:11:16.396749 13063 leader_election.cc:302] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba601218a7d84fe1a8fa93c8865cbd59; no voters:
I20260810 04:11:16.396862 13063 leader_election.cc:288] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:16.396901 13066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:16.397043 13066 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [term 1 LEADER]: Becoming Leader. State: Replica: ba601218a7d84fe1a8fa93c8865cbd59, State: Running, Role: LEADER
I20260810 04:11:16.397104 13063 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:16.397177 13066 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba601218a7d84fe1a8fa93c8865cbd59" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46653 } }
I20260810 04:11:16.397508 13067 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba601218a7d84fe1a8fa93c8865cbd59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba601218a7d84fe1a8fa93c8865cbd59" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46653 } } }
I20260810 04:11:16.397614 13067 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:16.397857 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 12983
I20260810 04:11:16.397955 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:16.398126 11238 external_mini_cluster.cc:1428] Setting key d4cd7c84d7f550f13c10d91c820708c9
I20260810 04:11:16.398176 13074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:16.398666 13074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:16.397511 13068 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba601218a7d84fe1a8fa93c8865cbd59. Latest consensus state: current_term: 1 leader_uuid: "ba601218a7d84fe1a8fa93c8865cbd59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba601218a7d84fe1a8fa93c8865cbd59" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46653 } } }
I20260810 04:11:16.399036 13068 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:16.400228 13074 catalog_manager.cc:1347] Generated new cluster ID: 04b0324018be49248b12f9694ff47011
I20260810 04:11:16.400285 13074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:16.407692 13074 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:16.408268 13074 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:16.410377 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.398641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54898 (local address 127.10.249.190:46653)
0810 04:11:16.399313 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.399321 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.399350 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:11:16.399446 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.399452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.399500 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.399626 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.400575 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.401423 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.402270 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.402706 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.402825 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.404890 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.404894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.404894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.404904 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.406517 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.406891 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.406894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.406895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.406992 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.407191 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.407192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.407193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.407478 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.407667 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.410047 (+ 2380us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.410193 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":631,"thread_start_us":69,"threads_started":1}
I20260810 04:11:16.411116 13074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: Generated new TSK 0
I20260810 04:11:16.411301 13074 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:16.440434 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46653
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:35573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:16.531404 13092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:16.531582 13092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:16.531605 13092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:16.532728 13092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:16.532769 13092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:16.532790 13092 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 04:11:16.532802 13092 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:11:16.532819 13092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:16.534255 13092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:35573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:46653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:16.534458 13092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:16.534675 13092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:11:16.539505 13092 server_base.cc:1034] running on GCE node
W20260810 04:11:16.539494 13097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:16.539579 13098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:16.539474 13100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:16.539987 13092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:16.540238 13092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:16.541396 13092 hybrid_clock.cc:648] HybridClock initialized: now 1786335076541381 us; error 28 us; skew 500 ppm
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:16.544104 13092 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:16.544544 13092 webserver.cc:460] Webserver started at http://127.10.249.129:42327/ using document root <none> and password file <none>
I20260810 04:11:16.544752 13092 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:16.544817 13092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:16.544968 13092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:16.546005 13092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "8af7fd140c23440e8917b3912f4a0895"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "99d8e94aad5c7eafa3c3c058737907b5"
server_key_iv: "605565453febad4fc3016769018fdd11"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.546350 13092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "8af7fd140c23440e8917b3912f4a0895"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "99d8e94aad5c7eafa3c3c058737907b5"
server_key_iv: "605565453febad4fc3016769018fdd11"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.547616 13092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:16.548306 13107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.548511 13092 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:16.548596 13092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "8af7fd140c23440e8917b3912f4a0895"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "99d8e94aad5c7eafa3c3c058737907b5"
server_key_iv: "605565453febad4fc3016769018fdd11"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.548653 13092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:16.561264 13092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:16.563046 13092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:16.563143 13092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:16.563545 13092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:16.563608 13092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.563658 13092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:16.563685 13092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.569818 13092 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:36535
I20260810 04:11:16.569908 13228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:36535 every 8 connection(s)
I20260810 04:11:16.570209 13092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:16.573199 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.564047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:60659 (local address 127.10.249.190:46653)
0810 04:11:16.564123 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.564125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.564316 (+ 191us) server_negotiation.cc:407] Connection header received
0810 04:11:16.564719 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.564720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.564734 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.564807 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.565622 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.566400 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.567791 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.568088 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.568170 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.570898 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.570899 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.570899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.570906 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.572087 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.572442 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.572443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.572443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.572494 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.572697 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.572698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.572698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.572794 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.572842 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.573071 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.573132 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 04:11:16.573341 13117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.564024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46653 (local address 127.10.249.129:60659)
0810 04:11:16.564194 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.564230 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.564634 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.564895 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.564901 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.565247 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:16.565510 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.565515 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.566494 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.566495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.567699 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.567702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.568214 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.568215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.568326 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.568919 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:16.568930 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:16.570811 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:16.572156 (+ 1345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.572162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.572164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.572377 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.572552 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.572553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.572553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.572643 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.572849 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:16.572853 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:16.572955 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.573045 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.573153 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":113,"threads_started":1}
I20260810 04:11:16.573899 13229 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46653
I20260810 04:11:16.573993 13229 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:16.574159 13229 heartbeater.cc:511] Master 127.10.249.190:46653 requested a full tablet report, sending...
I20260810 04:11:16.574738 13015 ts_manager.cc:194] Registered new tserver with Master: 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535)
I20260810 04:11:16.575387 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 13092
I20260810 04:11:16.575500 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:16.575676 11238 external_mini_cluster.cc:1428] Setting key b3f2c3608776548589e9ea7259532d9f
I20260810 04:11:16.575700 13015 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:60659
I20260810 04:11:16.580515 13235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.574922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46653 (local address 127.10.249.129:45697)
0810 04:11:16.575052 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.575063 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.575122 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.575232 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.575233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.575416 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:16.575466 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.575468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.576358 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.576359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.576939 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.576941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.577331 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.577332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.577401 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.577854 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:16.577858 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:16.578107 (+ 249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:16.579525 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.579526 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.579526 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.579690 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.579938 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.579938 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.579939 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.579996 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.580272 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:16.580273 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:16.580310 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.580366 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.580442 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260810 04:11:16.580612 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.574987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:45697 (local address 127.10.249.190:46653)
0810 04:11:16.575025 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.575027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.575110 (+ 83us) server_negotiation.cc:407] Connection header received
0810 04:11:16.575175 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.575175 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.575185 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.575227 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.575547 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.576246 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.577036 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.577251 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.577329 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.578197 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.578199 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.578199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.578206 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.579458 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.579777 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.579778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.579778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.579856 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.580061 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.580062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.580063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.580208 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.580275 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.580402 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.580484 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:16.600514 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46653
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:35573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:16.676151 13238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:16.676373 13238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:16.676410 13238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:16.677471 13238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:16.677534 13238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:16.677567 13238 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 04:11:16.677597 13238 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:11:16.677629 13238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:16.679064 13238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:35573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:46653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:16.679314 13238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:16.679548 13238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:16.684278 13247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:16.684337 13238 server_base.cc:1034] running on GCE node
W20260810 04:11:16.684267 13245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:16.684265 13244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:16.684672 13238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:16.684887 13238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:16.686020 13238 hybrid_clock.cc:648] HybridClock initialized: now 1786335076685994 us; error 42 us; skew 500 ppm
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:16.688303 13238 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:16.688696 13238 webserver.cc:460] Webserver started at http://127.10.249.130:37697/ using document root <none> and password file <none>
I20260810 04:11:16.688867 13238 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:16.688905 13238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:16.688980 13238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:16.689903 13238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "5acb92a864044483a42e72e0c14b14a6"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "1a1f9f8dc757a83662df99b7eb5ff3cf"
server_key_iv: "15e2e46ec52ae43c2a6b60c10f80ec22"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.690179 13238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "5acb92a864044483a42e72e0c14b14a6"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "1a1f9f8dc757a83662df99b7eb5ff3cf"
server_key_iv: "15e2e46ec52ae43c2a6b60c10f80ec22"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.691226 13238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:16.691895 13254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.692065 13238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:16.692173 13238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "5acb92a864044483a42e72e0c14b14a6"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "1a1f9f8dc757a83662df99b7eb5ff3cf"
server_key_iv: "15e2e46ec52ae43c2a6b60c10f80ec22"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.692247 13238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:16.716193 13238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:16.718362 13238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:16.718513 13238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:16.719007 13238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:16.719062 13238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.719129 13238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:16.719174 13238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:16.726202 13238 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:37075
I20260810 04:11:16.726290 13374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:37075 every 8 connection(s)
I20260810 04:11:16.726606 13238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:11:16.728880 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.719462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:50035 (local address 127.10.249.190:46653)
0810 04:11:16.719541 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.719544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.719773 (+ 229us) server_negotiation.cc:407] Connection header received
0810 04:11:16.720238 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.720240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.720253 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.720337 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.720969 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.721473 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.722636 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.722909 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.723030 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.725686 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.725687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.725688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.725696 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.727414 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.727876 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.727877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.727878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.727950 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.728227 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.728228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.728229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.728354 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.728439 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.728703 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.728790 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 04:11:16.729053 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.719448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46653 (local address 127.10.249.130:50035)
0810 04:11:16.719636 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.719671 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.720132 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.720385 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.720387 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.720678 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:16.720850 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.720855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.721583 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.721585 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.722515 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.722518 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.723041 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.723042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.723155 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.723626 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:16.723633 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:16.725572 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:16.727529 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.727536 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.727538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.727768 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.728027 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.728028 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.728028 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.728152 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.728430 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:16.728437 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:16.728566 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.728677 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.728821 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":120,"threads_started":1}
I20260810 04:11:16.729599 13375 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46653
I20260810 04:11:16.729684 13375 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:16.729888 13375 heartbeater.cc:511] Master 127.10.249.190:46653 requested a full tablet report, sending...
I20260810 04:11:16.730253 13016 ts_manager.cc:194] Registered new tserver with Master: 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075)
I20260810 04:11:16.730633 13016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:50035
I20260810 04:11:16.735113 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 13238
I20260810 04:11:16.735230 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:16.735410 11238 external_mini_cluster.cc:1428] Setting key 3035b5a7ed7d821c48f5b39dc175d9e5
I20260810 04:11:16.736716 13381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.730710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46653 (local address 127.10.249.130:45723)
0810 04:11:16.730877 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.730887 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.730939 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.731390 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.731391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.731548 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:16.731593 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.731594 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.732392 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.732393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.732875 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.732876 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.733214 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.733215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.733268 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.733630 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:16.733634 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:16.733955 (+ 321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:16.735656 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.735657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.735658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.735846 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.736058 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.736059 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.736059 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.736137 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.736499 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:16.736499 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:16.736543 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.736593 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.736662 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":71,"threads_started":1}
I20260810 04:11:16.736846 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.730768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:45723 (local address 127.10.249.190:46653)
0810 04:11:16.730805 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.730807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.730938 (+ 131us) server_negotiation.cc:407] Connection header received
0810 04:11:16.731312 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.731313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.731322 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.731376 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.731661 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.732302 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.732940 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.733149 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.733200 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.734041 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.734042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.734042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.734047 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.735581 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.735927 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.735928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.735928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.735992 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.736217 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.736218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.736218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.736432 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.736499 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.736639 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.736724 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:16.759810 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46653
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:35573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:16.835480 13386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:16.835641 13386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:16.835661 13386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:16.836643 13386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:16.836680 13386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:16.836699 13386 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 04:11:16.836730 13386 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:11:16.836758 13386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:16.838091 13386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:35573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:46653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:16.838264 13386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:16.838478 13386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:16.843250 13391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:16.843297 13392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:16.843340 13386 server_base.cc:1034] running on GCE node
W20260810 04:11:16.843278 13394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:16.843622 13386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:16.843852 13386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:16.845005 13386 hybrid_clock.cc:648] HybridClock initialized: now 1786335076844986 us; error 31 us; skew 500 ppm
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:16.847141 13386 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:16.847498 13386 webserver.cc:460] Webserver started at http://127.10.249.131:43799/ using document root <none> and password file <none>
I20260810 04:11:16.847699 13386 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:16.847760 13386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:16.847894 13386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:16.848771 13386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "b7ffc17ff38fb673516214933c2795a6"
server_key_iv: "6bb41c0cb7c2eda040ef50e0bc84958d"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.849097 13386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "b7ffc17ff38fb673516214933c2795a6"
server_key_iv: "6bb41c0cb7c2eda040ef50e0bc84958d"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.850467 13386 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:11:16.851238 13401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.851382 13386 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:16.851500 13386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68"
format_stamp: "Formatted at 2026-08-10 04:11:16 on dist-test-slave-0kls"
server_key: "b7ffc17ff38fb673516214933c2795a6"
server_key_iv: "6bb41c0cb7c2eda040ef50e0bc84958d"
server_key_version: "encryptionkey@0"
I20260810 04:11:16.851547 13386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:16.871850 13386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:16.874233 13386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:16.874366 13386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:16.874804 13386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:16.874838 13386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.874858 13386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:16.874897 13386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.881256 13386 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:42139
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:16.881330 13519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:42139 every 8 connection(s)
I20260810 04:11:16.881600 13386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:16.884100 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 13386
I20260810 04:11:16.884212 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:16.884258 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.875216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:45685 (local address 127.10.249.190:46653)
0810 04:11:16.875290 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.875292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.875483 (+ 191us) server_negotiation.cc:407] Connection header received
0810 04:11:16.875893 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.875894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.875908 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.875983 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.876733 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.877476 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.878873 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.879176 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.879239 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.881863 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.881865 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.881866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.881875 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.883051 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.883390 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.883391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.883391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.883437 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.883687 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.883687 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.883688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.883777 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.883823 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.884079 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.884135 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:11:16.884385 11238 external_mini_cluster.cc:1428] Setting key 9dd5eb55d9a59c597b483eb9160dbf8c
I20260810 04:11:16.884419 13410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.875211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46653 (local address 127.10.249.131:45685)
0810 04:11:16.875372 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.875405 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.875805 (+ 400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.876057 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.876060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.876390 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:16.876634 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.876639 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.877574 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.877575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.878787 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.878790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.879256 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.879257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.879398 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.879928 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:16.879939 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:16.881723 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:16.883130 (+ 1407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.883136 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.883137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.883327 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.883531 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.883532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.883532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.883631 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.883830 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:16.883834 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:16.883953 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.884064 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.884221 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":101,"threads_started":1}
I20260810 04:11:16.884842 13520 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46653
I20260810 04:11:16.884918 13520 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:16.885082 13520 heartbeater.cc:511] Master 127.10.249.190:46653 requested a full tablet report, sending...
I20260810 04:11:16.885412 13016 ts_manager.cc:194] Registered new tserver with Master: 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:16.885764 13016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:45685
I20260810 04:11:16.886083 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:11:16.890794 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.885822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:54729 (local address 127.10.249.190:46653)
0810 04:11:16.885857 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.885859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.885991 (+ 132us) server_negotiation.cc:407] Connection header received
0810 04:11:16.886031 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.886032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.886041 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.886089 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.886422 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.886851 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.887528 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.887709 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.887776 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.888602 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.888603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.888603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.888609 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.889825 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.890144 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.890145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.890145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.890205 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.890380 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.890381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.890381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.890478 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.890541 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.890657 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.890720 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:11:16.890807 13526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.885764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46653 (local address 127.10.249.131:54729)
0810 04:11:16.885905 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.885913 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.885982 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.886098 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.886098 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.886288 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:16.886349 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.886350 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.886946 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.886947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.887436 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.887437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.887776 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.887777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.887844 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.888250 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:16.888255 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:16.888516 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:16.889915 (+ 1399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.889916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.889916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.890071 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.890266 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.890267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.890268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.890318 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.890535 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:16.890536 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:16.890574 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.890634 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.890722 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":100,"threads_started":1}
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:16.908061 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.902181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54902 (local address 127.10.249.190:46653)
0810 04:11:16.902242 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.902243 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.902251 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:16.902267 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.902268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.902276 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.902321 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.902804 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.903239 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.903830 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.903974 (+ 144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.904014 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.905955 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.905956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.905957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.905964 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.907044 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.907367 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.907368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.907368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.907420 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.907621 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.907622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.907622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.907713 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.907810 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.907909 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.907975 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:11:16.909328 13015 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:16.910871 13015 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:16.916649 13541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.913288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37075 (local address 127.0.0.1:33252)
0810 04:11:16.913500 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.913509 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.913551 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.913715 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.913716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.913718 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:16.913770 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.913771 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.914862 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.914863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.915646 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.915649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.916459 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.916459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.916510 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.916520 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.916565 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.916596 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":89,"thread_start_us":42,"threads_started":1}
I20260810 04:11:16.916705 13542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.913401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33252 (local address 127.10.249.130:37075)
0810 04:11:16.913552 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.913555 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.913584 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:11:16.913617 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.913619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.913633 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.913701 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:16.913838 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.914794 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.915733 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.916383 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.916455 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.916501 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.916586 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.916616 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":66,"threads_started":1}
I20260810 04:11:16.917101 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.913400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:42139 (local address 127.0.0.1:41784)
0810 04:11:16.913598 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.913604 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.913631 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.913976 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.913977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.913978 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:16.914029 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.914030 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.914790 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.914791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.916075 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.916077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.916896 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.916897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.916961 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.916965 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.917010 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.917047 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":64,"thread_start_us":57,"threads_started":1}
I20260810 04:11:16.917311 13543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.913477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41784 (local address 127.10.249.131:42139)
0810 04:11:16.913746 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.913751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.913760 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:16.913791 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.913793 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.913890 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.914095 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:16.914140 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.914703 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.916150 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.916814 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.916878 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.916941 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.917197 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.917235 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":66,"threads_started":1}
I20260810 04:11:16.917498 13307 tablet_service.cc:1467] Processing CreateTablet for tablet 04ec462c3be34299a8179d98ede23c8d (DEFAULT_TABLE table=test-table [id=89cfd6ee5e624758abd0d3670e0f3a05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:16.917842 13307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04ec462c3be34299a8179d98ede23c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:16.917996 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.913104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36535 (local address 127.0.0.1:50222)
0810 04:11:16.913190 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.913225 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.913279 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.913650 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.913654 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.913657 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:16.913715 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.913716 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.914947 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.914947 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.916074 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.916077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.917750 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.917751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.917842 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.917845 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.917897 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.917932 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":40,"thread_start_us":53,"threads_started":1}
I20260810 04:11:16.918046 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.913221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50222 (local address 127.10.249.129:36535)
0810 04:11:16.913413 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.913419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.913429 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:16.913467 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.913469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.913483 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.913559 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:16.913809 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.914809 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.916980 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.917686 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.917749 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.917846 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.917910 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.917939 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":92,"threads_started":1}
I20260810 04:11:16.920382 13544 tablet_bootstrap.cc:492] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Bootstrap starting.
I20260810 04:11:16.920912 13161 tablet_service.cc:1467] Processing CreateTablet for tablet 04ec462c3be34299a8179d98ede23c8d (DEFAULT_TABLE table=test-table [id=89cfd6ee5e624758abd0d3670e0f3a05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:16.920907 13451 tablet_service.cc:1467] Processing CreateTablet for tablet 04ec462c3be34299a8179d98ede23c8d (DEFAULT_TABLE table=test-table [id=89cfd6ee5e624758abd0d3670e0f3a05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:16.921144 13544 tablet_bootstrap.cc:654] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:16.921274 13451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04ec462c3be34299a8179d98ede23c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:16.921274 13161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04ec462c3be34299a8179d98ede23c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:16.921499 13544 log.cc:824] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:16.922266 13544 tablet_bootstrap.cc:492] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: No bootstrap required, opened a new log
I20260810 04:11:16.922353 13544 ts_tablet_manager.cc:1397] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:16.923636 13544 raft_consensus.cc:348] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.923772 13544 raft_consensus.cc:374] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:16.923828 13544 raft_consensus.cc:729] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5acb92a864044483a42e72e0c14b14a6, State: Initialized, Role: FOLLOWER
I20260810 04:11:16.923957 13544 consensus_queue.cc:260] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.924206 13544 ts_tablet_manager.cc:1428] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:16.924234 13375 heartbeater.cc:503] Master 127.10.249.190:46653 was elected leader, sending a full tablet report...
I20260810 04:11:16.924842 13549 tablet_bootstrap.cc:492] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Bootstrap starting.
I20260810 04:11:16.924999 13548 tablet_bootstrap.cc:492] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Bootstrap starting.
I20260810 04:11:16.925478 13549 tablet_bootstrap.cc:654] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:16.925802 13549 log.cc:824] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:16.925889 13548 tablet_bootstrap.cc:654] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:16.926175 13548 log.cc:824] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:16.926474 13549 tablet_bootstrap.cc:492] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: No bootstrap required, opened a new log
I20260810 04:11:16.926546 13549 ts_tablet_manager.cc:1397] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:16.926826 13548 tablet_bootstrap.cc:492] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: No bootstrap required, opened a new log
I20260810 04:11:16.926887 13548 ts_tablet_manager.cc:1397] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:11:16.927874 13549 raft_consensus.cc:348] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.928004 13549 raft_consensus.cc:374] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:16.928046 13549 raft_consensus.cc:729] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af7fd140c23440e8917b3912f4a0895, State: Initialized, Role: FOLLOWER
I20260810 04:11:16.928162 13549 consensus_queue.cc:260] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.928194 13548 raft_consensus.cc:348] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.928329 13548 raft_consensus.cc:374] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:16.928372 13548 raft_consensus.cc:729] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be8f9a70e624c0cbf6a1e9530ad2f68, State: Initialized, Role: FOLLOWER
I20260810 04:11:16.928403 13229 heartbeater.cc:503] Master 127.10.249.190:46653 was elected leader, sending a full tablet report...
I20260810 04:11:16.928479 13548 consensus_queue.cc:260] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.928612 13549 ts_tablet_manager.cc:1428] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:16.928710 13548 ts_tablet_manager.cc:1428] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:11:16.928861 13520 heartbeater.cc:503] Master 127.10.249.190:46653 was elected leader, sending a full tablet report...
I20260810 04:11:16.956544 13547 raft_consensus.cc:482] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:16.956653 13547 raft_consensus.cc:504] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.957046 13547 leader_election.cc:288] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535), 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:16.960165 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.957244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36535 (local address 127.10.249.130:39323)
0810 04:11:16.957317 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.957331 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.957387 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.957552 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.957553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.957555 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:16.957626 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.957628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.958357 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.958358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.959348 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.959351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.959900 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.959901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.959981 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.959986 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.960059 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.960097 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 04:11:16.960165 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.957321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:39323 (local address 127.10.249.129:36535)
0810 04:11:16.957400 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.957403 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.957414 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:11:16.957446 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.957447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.957459 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.957518 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:16.957717 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.958263 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.959439 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.959817 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.959903 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.959913 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.960066 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.960101 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:11:16.960280 13554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.957377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:42139 (local address 127.10.249.130:39327)
0810 04:11:16.957593 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.957603 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.957657 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.957837 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.957838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.957840 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:16.957924 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.957925 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.958522 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.958523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.959450 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.959452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.959991 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.959992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.960072 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.960076 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.960161 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.960200 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":118,"threads_started":1}
I20260810 04:11:16.960270 13543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.957548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:39327 (local address 127.10.249.131:42139)
0810 04:11:16.957592 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.957594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.957656 (+ 62us) server_negotiation.cc:407] Connection header received
0810 04:11:16.957712 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.957713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.957722 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.957822 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:16.957996 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.958442 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.959537 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.959905 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.959989 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.959997 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.960174 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.960207 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:11:16.960515 13181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04ec462c3be34299a8179d98ede23c8d" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7fd140c23440e8917b3912f4a0895" is_pre_election: true
I20260810 04:11:16.960513 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04ec462c3be34299a8179d98ede23c8d" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" is_pre_election: true
I20260810 04:11:16.960670 13473 raft_consensus.cc:2454] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 0.
I20260810 04:11:16.960669 13181 raft_consensus.cc:2454] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 0.
I20260810 04:11:16.960896 13258 leader_election.cc:302] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be8f9a70e624c0cbf6a1e9530ad2f68, 5acb92a864044483a42e72e0c14b14a6; no voters:
I20260810 04:11:16.961040 13547 raft_consensus.cc:2781] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:16.961099 13547 raft_consensus.cc:482] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:16.961123 13547 raft_consensus.cc:3037] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:16.961885 13547 raft_consensus.cc:504] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.962011 13547 leader_election.cc:288] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 election: Requested vote from peers 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535), 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:16.962152 13181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04ec462c3be34299a8179d98ede23c8d" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7fd140c23440e8917b3912f4a0895"
I20260810 04:11:16.962182 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04ec462c3be34299a8179d98ede23c8d" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68"
I20260810 04:11:16.962247 13181 raft_consensus.cc:3037] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:16.962252 13473 raft_consensus.cc:3037] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:16.962925 13473 raft_consensus.cc:2454] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 1.
I20260810 04:11:16.963029 13181 raft_consensus.cc:2454] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 1.
I20260810 04:11:16.963088 13258 leader_election.cc:302] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be8f9a70e624c0cbf6a1e9530ad2f68, 5acb92a864044483a42e72e0c14b14a6; no voters:
I20260810 04:11:16.963207 13547 raft_consensus.cc:2781] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:16.963366 13547 raft_consensus.cc:686] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 1 LEADER]: Becoming Leader. State: Replica: 5acb92a864044483a42e72e0c14b14a6, State: Running, Role: LEADER
I20260810 04:11:16.963470 13547 consensus_queue.cc:237] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.964238 13015 catalog_manager.cc:5495] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130). New cstate: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } health_report { overall_health: UNKNOWN } } }
W20260810 04:11:16.977138 13376 tablet.cc:2369] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 04:11:16 dist-test-slave-0kls krb5kdc[12970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335076, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:16.992491 13562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.986300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46653 (local address 127.0.0.1:54904)
0810 04:11:16.986452 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:16.986461 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:16.986531 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:16.986653 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:16.986654 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:16.986936 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:16.986974 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.986976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.987555 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.987556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.988046 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:16.988047 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.988370 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.988371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:16.988438 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.989048 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:16.989052 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:16.990336 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:16.991608 (+ 1272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.991614 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.991616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.991799 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.991987 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:16.991988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:16.991988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:16.992040 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:16.992244 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:16.992250 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:16.992289 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 04:11:16.992339 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:11:16.992423 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260810 04:11:16.992585 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:16.986338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54904 (local address 127.10.249.190:46653)
0810 04:11:16.986402 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:16.986404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:16.986516 (+ 112us) server_negotiation.cc:407] Connection header received
0810 04:11:16.986594 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:16.986595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:16.986604 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:16.986651 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:16.987058 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.987481 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.988134 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:16.988298 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:16.988360 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:16.990411 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:16.990412 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:16.990412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:16.990418 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:16.991543 (+ 1125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.991881 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.991882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.991882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.991931 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:16.992092 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:16.992092 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:16.992092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:16.992185 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:16.992233 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:16.992370 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 04:11:16.992469 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":42}
I20260810 04:11:16.994287 13015 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:54904:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 04:11:16.994501 13015 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:16.995877 13161 tablet_service.cc:1467] Processing CreateTablet for tablet 12c31f22de6f4ef586a8625015ec1e78 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a0c92aaedf81449fb0863bf33359bf9f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:11:16.996061 13161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12c31f22de6f4ef586a8625015ec1e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:16.996034 13307 tablet_service.cc:1467] Processing CreateTablet for tablet 12c31f22de6f4ef586a8625015ec1e78 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a0c92aaedf81449fb0863bf33359bf9f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:11:16.996261 13307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12c31f22de6f4ef586a8625015ec1e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:16.997596 13549 tablet_bootstrap.cc:492] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: Bootstrap starting.
I20260810 04:11:16.997684 13451 tablet_service.cc:1467] Processing CreateTablet for tablet 12c31f22de6f4ef586a8625015ec1e78 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a0c92aaedf81449fb0863bf33359bf9f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:11:16.997737 13544 tablet_bootstrap.cc:492] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: Bootstrap starting.
I20260810 04:11:16.997851 13451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12c31f22de6f4ef586a8625015ec1e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:16.998284 13544 tablet_bootstrap.cc:654] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:16.998387 13549 tablet_bootstrap.cc:654] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:16.999054 13544 tablet_bootstrap.cc:492] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: No bootstrap required, opened a new log
I20260810 04:11:16.999092 13549 tablet_bootstrap.cc:492] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: No bootstrap required, opened a new log
I20260810 04:11:16.999137 13549 ts_tablet_manager.cc:1397] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:16.999136 13544 ts_tablet_manager.cc:1397] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:16.999262 13548 tablet_bootstrap.cc:492] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Bootstrap starting.
I20260810 04:11:16.999307 13549 raft_consensus.cc:348] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.999302 13544 raft_consensus.cc:348] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.999377 13549 raft_consensus.cc:374] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:16.999383 13544 raft_consensus.cc:374] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:16.999398 13549 raft_consensus.cc:729] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af7fd140c23440e8917b3912f4a0895, State: Initialized, Role: FOLLOWER
I20260810 04:11:16.999408 13544 raft_consensus.cc:729] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5acb92a864044483a42e72e0c14b14a6, State: Initialized, Role: FOLLOWER
I20260810 04:11:16.999444 13549 consensus_queue.cc:260] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.999476 13544 consensus_queue.cc:260] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:16.999545 13549 ts_tablet_manager.cc:1428] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:16.999599 13552 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:16.999670 13552 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:16.999650 13547 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:16.999717 13547 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:16.999842 13544 ts_tablet_manager.cc:1428] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:17.000257 13548 tablet_bootstrap.cc:654] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:17.000975 13548 tablet_bootstrap.cc:492] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: No bootstrap required, opened a new log
I20260810 04:11:17.001036 13548 ts_tablet_manager.cc:1397] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:11:17.001183 13548 raft_consensus.cc:348] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.001272 13548 raft_consensus.cc:374] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:17.001304 13548 raft_consensus.cc:729] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be8f9a70e624c0cbf6a1e9530ad2f68, State: Initialized, Role: FOLLOWER
I20260810 04:11:17.001387 13548 consensus_queue.cc:260] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.001488 13548 ts_tablet_manager.cc:1428] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:17.001557 13553 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:17.001680 13553 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 04:11:17.070962 13230 tablet.cc:2369] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:11:17.132316 13521 tablet.cc:2369] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:11:17.174983 13547 raft_consensus.cc:482] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:17.175078 13547 raft_consensus.cc:504] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.175246 13547 leader_election.cc:288] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535), 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:17.175495 13181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12c31f22de6f4ef586a8625015ec1e78" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7fd140c23440e8917b3912f4a0895" is_pre_election: true
I20260810 04:11:17.175582 13181 raft_consensus.cc:2454] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 0.
I20260810 04:11:17.175520 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12c31f22de6f4ef586a8625015ec1e78" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" is_pre_election: true
I20260810 04:11:17.175663 13473 raft_consensus.cc:2454] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 0.
I20260810 04:11:17.175760 13258 leader_election.cc:302] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5acb92a864044483a42e72e0c14b14a6, 8af7fd140c23440e8917b3912f4a0895; no voters:
I20260810 04:11:17.175886 13547 raft_consensus.cc:2781] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:17.175921 13547 raft_consensus.cc:482] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:17.175935 13547 raft_consensus.cc:3037] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:17.176571 13547 raft_consensus.cc:504] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.176689 13547 leader_election.cc:288] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 election: Requested vote from peers 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535), 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:17.176882 13181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12c31f22de6f4ef586a8625015ec1e78" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7fd140c23440e8917b3912f4a0895"
I20260810 04:11:17.176956 13181 raft_consensus.cc:3037] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:17.176918 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12c31f22de6f4ef586a8625015ec1e78" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68"
I20260810 04:11:17.177043 13473 raft_consensus.cc:3037] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:17.177577 13181 raft_consensus.cc:2454] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 1.
I20260810 04:11:17.177703 13473 raft_consensus.cc:2454] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 1.
I20260810 04:11:17.177742 13258 leader_election.cc:302] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5acb92a864044483a42e72e0c14b14a6, 8af7fd140c23440e8917b3912f4a0895; no voters:
I20260810 04:11:17.177847 13547 raft_consensus.cc:2781] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:17.177904 13547 raft_consensus.cc:686] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [term 1 LEADER]: Becoming Leader. State: Replica: 5acb92a864044483a42e72e0c14b14a6, State: Running, Role: LEADER
I20260810 04:11:17.177965 13547 consensus_queue.cc:237] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.178283 13555 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: TxnStatusTablet state changed. Reason: New leader 5acb92a864044483a42e72e0c14b14a6. Latest consensus state: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:17.178363 13555 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:11:17.178583 13015 catalog_manager.cc:5495] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130). New cstate: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260810 04:11:17.178913 13568 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 04:11:17.179044 13568 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 04:11:17.227675 13542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.225324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33264 (local address 127.10.249.130:37075)
0810 04:11:17.225376 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:17.225378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:17.225386 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:17.225475 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:17.225476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:17.225501 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:17.225567 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:17.225700 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.226176 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.226889 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.227059 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.227144 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.227324 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.227437 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.227508 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:17.227583 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 04:11:17.227603 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:11:17.227705 13562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.225251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37075 (local address 127.0.0.1:33264)
0810 04:11:17.225332 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:17.225344 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:17.225402 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:17.225577 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:17.225578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:17.225580 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:17.225628 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.225631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.226260 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.226261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.226801 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.226803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.227145 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.227147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.227210 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.227227 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.227500 (+ 273us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.227510 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 04:11:17.227575 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 04:11:17.227626 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 04:11:17.229350 13473 raft_consensus.cc:1261] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Refusing update from remote peer 5acb92a864044483a42e72e0c14b14a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:17.229410 13181 raft_consensus.cc:1261] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Refusing update from remote peer 5acb92a864044483a42e72e0c14b14a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:17.229728 13555 consensus_queue.cc:1035] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:17.229936 13547 consensus_queue.cc:1035] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:17.231142 13552 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: TxnStatusTablet state changed. Reason: New leader 5acb92a864044483a42e72e0c14b14a6. Latest consensus state: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:17.231151 13553 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: TxnStatusTablet state changed. Reason: New leader 5acb92a864044483a42e72e0c14b14a6. Latest consensus state: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:17.231256 13553 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:17.231256 13552 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:17.232270 13555 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:17.232363 13555 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:11:17.232988 13553 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:17.233088 13553 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 0be8f9a70e624c0cbf6a1e9530ad2f68: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:17.233261 13547 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:17.233336 13547 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 5acb92a864044483a42e72e0c14b14a6: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:11:17.233352 13573 mvcc.cc:205] Tried to move back new op lower bound from 7316828476328886272 to 7316828476121296896. Current Snapshot: MvccSnapshot[applied={T|T < 7316828476328886272}]
I20260810 04:11:17.233733 13552 tablet_replica.cc:439] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } } }
I20260810 04:11:17.233830 13552 tablet_replica.cc:442] T 12c31f22de6f4ef586a8625015ec1e78 P 8af7fd140c23440e8917b3912f4a0895: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:11:17.234138 13571 mvcc.cc:205] Tried to move back new op lower bound from 7316828476328886272 to 7316828476121296896. Current Snapshot: MvccSnapshot[applied={T|T < 7316828476328886272 or (T in {7316828476328886272})}]
I20260810 04:11:17.234591 13572 mvcc.cc:205] Tried to move back new op lower bound from 7316828476328886272 to 7316828476121296896. Current Snapshot: MvccSnapshot[applied={T|T < 7316828476328886272 or (T in {7316828476328886272})}]
I20260810 04:11:17.237077 13542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.234856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33280 (local address 127.10.249.130:37075)
0810 04:11:17.234909 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:17.234911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:17.234938 (+ 27us) server_negotiation.cc:407] Connection header received
0810 04:11:17.234987 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:17.234988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:17.234998 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:17.235058 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:17.235148 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.235772 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.236424 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.236676 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.236735 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.236864 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.236891 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.236937 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:17.237022 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 04:11:17.237038 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:11:17.241715 13542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.239223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:51041 (local address 127.10.249.130:37075)
0810 04:11:17.239279 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:17.239281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:17.239436 (+ 155us) server_negotiation.cc:407] Connection header received
0810 04:11:17.239458 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:17.239458 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:17.239467 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:17.239520 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:17.239612 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.240286 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.241035 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.241285 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.241350 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.241501 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.241527 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.241580 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:17.241631 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 04:11:17.241648 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:11:17.241725 13582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.239177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37075 (local address 127.10.249.130:51041)
0810 04:11:17.239339 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:17.239348 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:17.239403 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:17.239522 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:17.239522 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:17.239523 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:17.239565 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.239566 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.240369 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.240370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.240936 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.240938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.241364 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.241365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.241409 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.241420 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.241586 (+ 166us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.241587 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:11:17.241615 (+ 28us) client_negotiation.cc:240] Negotiation successful
0810 04:11:17.241651 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":4,"thread_start_us":95,"threads_started":1}
I20260810 04:11:17.243952 13473 raft_consensus.cc:1261] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Refusing update from remote peer 5acb92a864044483a42e72e0c14b14a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:17.243952 13181 raft_consensus.cc:1261] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Refusing update from remote peer 5acb92a864044483a42e72e0c14b14a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:17.244186 13555 consensus_queue.cc:1035] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:17.244304 13555 consensus_queue.cc:1035] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:17.257830 13016 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:17.257922 13016 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:17.258674 13016 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: Sending DeleteTablet for 3 replicas of tablet 04ec462c3be34299a8179d98ede23c8d
I20260810 04:11:17.259007 13451 tablet_service.cc:1514] Processing DeleteTablet for tablet 04ec462c3be34299a8179d98ede23c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:17 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:41784
I20260810 04:11:17.259064 13307 tablet_service.cc:1514] Processing DeleteTablet for tablet 04ec462c3be34299a8179d98ede23c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:17 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:33252
I20260810 04:11:17.259193 13161 tablet_service.cc:1514] Processing DeleteTablet for tablet 04ec462c3be34299a8179d98ede23c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:17 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:50222
I20260810 04:11:17.259286 13588 tablet_replica.cc:330] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: stopping tablet replica
I20260810 04:11:17.259378 13588 raft_consensus.cc:2229] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:11:17.259361 13016 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:17.259475 13016 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:17.259491 13588 raft_consensus.cc:2258] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:17.259895 13588 ts_tablet_manager.cc:1905] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:17.260722 13161 tablet_service.cc:1467] Processing CreateTablet for tablet d0183d49626a4af38d68d5a5eed9f98f (DEFAULT_TABLE table=test-table [id=8fbcb98b7ccf4d85b371f2f9d8145bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:17.260730 13307 tablet_service.cc:1467] Processing CreateTablet for tablet d0183d49626a4af38d68d5a5eed9f98f (DEFAULT_TABLE table=test-table [id=8fbcb98b7ccf4d85b371f2f9d8145bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:17.260833 13307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0183d49626a4af38d68d5a5eed9f98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:17.260840 13161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0183d49626a4af38d68d5a5eed9f98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:17.261950 13544 tablet_bootstrap.cc:492] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: Bootstrap starting.
I20260810 04:11:17.262080 13588 ts_tablet_manager.cc:1918] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:17.262143 13549 tablet_bootstrap.cc:492] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: Bootstrap starting.
I20260810 04:11:17.262241 13588 log.cc:1196] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/04ec462c3be34299a8179d98ede23c8d
I20260810 04:11:17.262380 13544 tablet_bootstrap.cc:654] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:17.262557 13589 tablet_replica.cc:330] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: stopping tablet replica
I20260810 04:11:17.262578 13549 tablet_bootstrap.cc:654] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:17.262742 13588 ts_tablet_manager.cc:1939] T 04ec462c3be34299a8179d98ede23c8d P 5acb92a864044483a42e72e0c14b14a6: Deleting consensus metadata
I20260810 04:11:17.260701 13451 tablet_service.cc:1467] Processing CreateTablet for tablet d0183d49626a4af38d68d5a5eed9f98f (DEFAULT_TABLE table=test-table [id=8fbcb98b7ccf4d85b371f2f9d8145bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:17.263047 13451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0183d49626a4af38d68d5a5eed9f98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:17.263285 13002 catalog_manager.cc:4841] TS 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075): tablet 04ec462c3be34299a8179d98ede23c8d (table test-table [id=89cfd6ee5e624758abd0d3670e0f3a05]) successfully deleted
I20260810 04:11:17.264343 13548 tablet_bootstrap.cc:492] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: Bootstrap starting.
I20260810 04:11:17.264621 13549 tablet_bootstrap.cc:492] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: No bootstrap required, opened a new log
I20260810 04:11:17.264669 13549 ts_tablet_manager.cc:1397] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 04:11:17.264704 13548 tablet_bootstrap.cc:654] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:17.264791 13549 raft_consensus.cc:348] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.264853 13549 raft_consensus.cc:374] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:17.264869 13549 raft_consensus.cc:729] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af7fd140c23440e8917b3912f4a0895, State: Initialized, Role: FOLLOWER
I20260810 04:11:17.264904 13549 consensus_queue.cc:260] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.264981 13549 ts_tablet_manager.cc:1428] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:17.265211 13589 raft_consensus.cc:2229] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:17.265280 13589 raft_consensus.cc:2258] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:17.259858 13587 tablet_replica.cc:330] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: stopping tablet replica
I20260810 04:11:17.265517 13587 raft_consensus.cc:2229] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:17.265573 13587 raft_consensus.cc:2258] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:17.265970 13587 ts_tablet_manager.cc:1905] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:17.267371 13587 ts_tablet_manager.cc:1918] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:17.267443 13587 log.cc:1196] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/04ec462c3be34299a8179d98ede23c8d
I20260810 04:11:17.267664 13587 ts_tablet_manager.cc:1939] T 04ec462c3be34299a8179d98ede23c8d P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting consensus metadata
I20260810 04:11:17.268038 13002 catalog_manager.cc:4841] TS 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139): tablet 04ec462c3be34299a8179d98ede23c8d (table test-table [id=89cfd6ee5e624758abd0d3670e0f3a05]) successfully deleted
I20260810 04:11:17.268226 13589 ts_tablet_manager.cc:1905] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:17.269676 13589 ts_tablet_manager.cc:1918] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:17.269747 13589 log.cc:1196] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/04ec462c3be34299a8179d98ede23c8d
I20260810 04:11:17.270000 13589 ts_tablet_manager.cc:1939] T 04ec462c3be34299a8179d98ede23c8d P 8af7fd140c23440e8917b3912f4a0895: Deleting consensus metadata
I20260810 04:11:17.270354 13002 catalog_manager.cc:4841] TS 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535): tablet 04ec462c3be34299a8179d98ede23c8d (table test-table [id=89cfd6ee5e624758abd0d3670e0f3a05]) successfully deleted
I20260810 04:11:17.270545 13548 tablet_bootstrap.cc:492] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: No bootstrap required, opened a new log
I20260810 04:11:17.270574 13548 ts_tablet_manager.cc:1397] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260810 04:11:17.270676 13548 raft_consensus.cc:348] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.270723 13548 raft_consensus.cc:374] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:17.270735 13548 raft_consensus.cc:729] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be8f9a70e624c0cbf6a1e9530ad2f68, State: Initialized, Role: FOLLOWER
I20260810 04:11:17.270809 13548 consensus_queue.cc:260] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.270889 13548 ts_tablet_manager.cc:1428] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:17.274073 13544 tablet_bootstrap.cc:492] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: No bootstrap required, opened a new log
I20260810 04:11:17.274137 13544 ts_tablet_manager.cc:1397] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20260810 04:11:17.274251 13544 raft_consensus.cc:348] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.274313 13544 raft_consensus.cc:374] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:17.274335 13544 raft_consensus.cc:729] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5acb92a864044483a42e72e0c14b14a6, State: Initialized, Role: FOLLOWER
I20260810 04:11:17.274380 13544 consensus_queue.cc:260] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.274477 13544 ts_tablet_manager.cc:1428] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:17.330327 13552 raft_consensus.cc:482] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:17.330437 13552 raft_consensus.cc:504] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.330801 13552 leader_election.cc:288] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075), 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:17.333979 13543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.331177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:46137 (local address 127.10.249.131:42139)
0810 04:11:17.331227 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:17.331228 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:17.331335 (+ 107us) server_negotiation.cc:407] Connection header received
0810 04:11:17.331392 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:17.331393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:17.331402 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:17.331469 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:17.331613 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.332076 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.333152 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.333638 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.333716 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.333724 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:17.333881 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 04:11:17.333914 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:11:17.334005 13594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.331110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:42139 (local address 127.10.249.129:46137)
0810 04:11:17.331275 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:17.331282 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:17.331343 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:17.331471 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:17.331472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:17.331474 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:17.331544 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.331545 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.332160 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.332161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.333026 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.333028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.333721 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.333722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.333812 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.333817 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:11:17.333877 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:11:17.333912 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":59,"thread_start_us":33,"threads_started":1}
I20260810 04:11:17.334460 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.330942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37075 (local address 127.10.249.129:55237)
0810 04:11:17.331086 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:17.331097 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:17.331193 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:17.331381 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:17.331383 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:17.331386 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:17.331459 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.331461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.332348 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.332349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.333512 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.333514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.334162 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.334163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.334255 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.334259 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:17.334313 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:11:17.334354 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260810 04:11:17.334436 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0183d49626a4af38d68d5a5eed9f98f" candidate_uuid: "8af7fd140c23440e8917b3912f4a0895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" is_pre_election: true
I20260810 04:11:17.334571 13473 raft_consensus.cc:2454] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8af7fd140c23440e8917b3912f4a0895 in term 0.
I20260810 04:11:17.334730 13542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.331011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:55237 (local address 127.10.249.130:37075)
0810 04:11:17.331062 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:17.331064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:17.331152 (+ 88us) server_negotiation.cc:407] Connection header received
0810 04:11:17.331259 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:17.331260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:17.331270 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:17.331326 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:17.331527 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.332256 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.333585 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.334096 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.334162 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.334181 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:17.334623 (+ 442us) server_negotiation.cc:299] Negotiation successful
0810 04:11:17.334665 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:11:17.334738 13111 leader_election.cc:302] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be8f9a70e624c0cbf6a1e9530ad2f68, 8af7fd140c23440e8917b3912f4a0895; no voters:
I20260810 04:11:17.334854 13552 raft_consensus.cc:2781] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:17.334898 13552 raft_consensus.cc:482] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:17.334923 13552 raft_consensus.cc:3037] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:17.334972 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0183d49626a4af38d68d5a5eed9f98f" candidate_uuid: "8af7fd140c23440e8917b3912f4a0895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5acb92a864044483a42e72e0c14b14a6" is_pre_election: true
I20260810 04:11:17.335099 13323 raft_consensus.cc:2454] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8af7fd140c23440e8917b3912f4a0895 in term 0.
I20260810 04:11:17.335702 13552 raft_consensus.cc:504] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.335836 13552 leader_election.cc:288] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [CANDIDATE]: Term 1 election: Requested vote from peers 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075), 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:17.335960 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0183d49626a4af38d68d5a5eed9f98f" candidate_uuid: "8af7fd140c23440e8917b3912f4a0895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5acb92a864044483a42e72e0c14b14a6"
I20260810 04:11:17.336036 13323 raft_consensus.cc:3037] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:17.336798 13323 raft_consensus.cc:2454] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8af7fd140c23440e8917b3912f4a0895 in term 1.
I20260810 04:11:17.336898 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0183d49626a4af38d68d5a5eed9f98f" candidate_uuid: "8af7fd140c23440e8917b3912f4a0895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68"
I20260810 04:11:17.336966 13473 raft_consensus.cc:3037] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:17.337625 13473 raft_consensus.cc:2454] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8af7fd140c23440e8917b3912f4a0895 in term 1.
I20260810 04:11:17.337775 13111 leader_election.cc:302] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be8f9a70e624c0cbf6a1e9530ad2f68, 8af7fd140c23440e8917b3912f4a0895; no voters:
I20260810 04:11:17.337881 13552 raft_consensus.cc:2781] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:17.338016 13552 raft_consensus.cc:686] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 1 LEADER]: Becoming Leader. State: Replica: 8af7fd140c23440e8917b3912f4a0895, State: Running, Role: LEADER
I20260810 04:11:17.338081 13552 consensus_queue.cc:237] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:17.338737 13016 catalog_manager.cc:5495] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129). New cstate: current_term: 1 leader_uuid: "8af7fd140c23440e8917b3912f4a0895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260810 04:11:17.357438 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.355395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.10.249.129:36535)
0810 04:11:17.355436 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:17.355437 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:17.355443 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:11:17.355466 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:17.355467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:17.355480 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:17.355531 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:17.355648 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.356009 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.356862 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.357006 (+ 144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.357047 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.357186 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.357288 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.357333 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:17.357386 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 04:11:17.357399 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 04:11:17.362112 13542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.359712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:39309 (local address 127.10.249.130:37075)
0810 04:11:17.359753 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:17.359755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:17.359904 (+ 149us) server_negotiation.cc:407] Connection header received
0810 04:11:17.359977 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:17.359978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:17.359990 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:17.360038 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:17.360200 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.360632 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.361386 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.361584 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.361649 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.361880 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.361913 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.361980 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:17.362033 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 04:11:17.362050 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:11:17.362337 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.359655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37075 (local address 127.10.249.129:39309)
0810 04:11:17.359838 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:17.359847 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:17.359918 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:17.360041 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:17.360041 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:17.360043 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:17.360110 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.360111 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.360718 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.360719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.361302 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.361304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.361673 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.361675 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.361733 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.361744 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.361984 (+ 240us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.361986 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:11:17.362032 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 04:11:17.362069 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":72,"threads_started":1}
I20260810 04:11:17.364244 13473 raft_consensus.cc:1261] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Refusing update from remote peer 8af7fd140c23440e8917b3912f4a0895: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:17.364348 13323 raft_consensus.cc:1261] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Refusing update from remote peer 8af7fd140c23440e8917b3912f4a0895: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:17.364464 13595 consensus_queue.cc:1035] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:17.364559 13552 consensus_queue.cc:1035] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:17.371376 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.369198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:52977 (local address 127.10.249.129:36535)
0810 04:11:17.369230 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:17.369232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:17.369239 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:11:17.369258 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:17.369259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:17.369268 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:17.369314 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:17.369405 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.369970 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.370718 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.370913 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.370985 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.371146 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.371183 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.371240 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:17.371305 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 04:11:17.371322 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:11:17.371402 13582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:17.369074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36535 (local address 127.10.249.130:52977)
0810 04:11:17.369109 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:17.369119 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:17.369156 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:17.369315 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:17.369316 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:17.369317 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:17.369350 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.369351 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.370048 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.370049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.370629 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:17.370631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:17.370984 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:17.370985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:17.371036 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:17.371042 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:17.371261 (+ 219us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:17.371263 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:11:17.371302 (+ 39us) client_negotiation.cc:240] Negotiation successful
0810 04:11:17.371339 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
W20260810 04:11:17.371757 13572 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 04:11:18.891114 13016 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:18.891229 13016 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:18.892038 13016 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: Sending DeleteTablet for 3 replicas of tablet d0183d49626a4af38d68d5a5eed9f98f
I20260810 04:11:18.892364 13451 tablet_service.cc:1514] Processing DeleteTablet for tablet d0183d49626a4af38d68d5a5eed9f98f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:18 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:41784
I20260810 04:11:18.892366 13161 tablet_service.cc:1514] Processing DeleteTablet for tablet d0183d49626a4af38d68d5a5eed9f98f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:18 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:50222
I20260810 04:11:18.892562 13307 tablet_service.cc:1514] Processing DeleteTablet for tablet d0183d49626a4af38d68d5a5eed9f98f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:18 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:33252
I20260810 04:11:18.892581 13628 tablet_replica.cc:330] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: stopping tablet replica
I20260810 04:11:18.892637 13628 raft_consensus.cc:2229] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:18.892663 13628 raft_consensus.cc:2258] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:18.892765 13630 tablet_replica.cc:330] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: stopping tablet replica
I20260810 04:11:18.892853 13630 raft_consensus.cc:2229] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:18.892920 13630 raft_consensus.cc:2258] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:18.892921 13628 ts_tablet_manager.cc:1905] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:18.892931 13629 tablet_replica.cc:330] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: stopping tablet replica
I20260810 04:11:18.893047 13629 raft_consensus.cc:2229] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:11:18.893170 13629 raft_consensus.cc:2258] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:18.893411 13629 ts_tablet_manager.cc:1905] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:18.894593 13628 ts_tablet_manager.cc:1918] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:11:18.894662 13628 log.cc:1196] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/d0183d49626a4af38d68d5a5eed9f98f
I20260810 04:11:18.894903 13628 ts_tablet_manager.cc:1939] T d0183d49626a4af38d68d5a5eed9f98f P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting consensus metadata
I20260810 04:11:18.895207 13002 catalog_manager.cc:4841] TS 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139): tablet d0183d49626a4af38d68d5a5eed9f98f (table test-table [id=8fbcb98b7ccf4d85b371f2f9d8145bf1]) successfully deleted
I20260810 04:11:18.895255 13629 ts_tablet_manager.cc:1918] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:11:18.895319 13629 log.cc:1196] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/d0183d49626a4af38d68d5a5eed9f98f
I20260810 04:11:18.895490 13630 ts_tablet_manager.cc:1905] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:18.895608 13629 ts_tablet_manager.cc:1939] T d0183d49626a4af38d68d5a5eed9f98f P 8af7fd140c23440e8917b3912f4a0895: Deleting consensus metadata
I20260810 04:11:18.896123 13002 catalog_manager.cc:4841] TS 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535): tablet d0183d49626a4af38d68d5a5eed9f98f (table test-table [id=8fbcb98b7ccf4d85b371f2f9d8145bf1]) successfully deleted
I20260810 04:11:18.897022 13630 ts_tablet_manager.cc:1918] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:11:18.897066 13630 log.cc:1196] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/d0183d49626a4af38d68d5a5eed9f98f
I20260810 04:11:18.897274 13630 ts_tablet_manager.cc:1939] T d0183d49626a4af38d68d5a5eed9f98f P 5acb92a864044483a42e72e0c14b14a6: Deleting consensus metadata
I20260810 04:11:18.897727 13002 catalog_manager.cc:4841] TS 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075): tablet d0183d49626a4af38d68d5a5eed9f98f (table test-table [id=8fbcb98b7ccf4d85b371f2f9d8145bf1]) successfully deleted
Aug 10 04:11:18 dist-test-slave-0kls krb5kdc[12970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335078, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:11:18 dist-test-slave-0kls krb5kdc[12970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335078, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:18.915905 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:18.909301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.10.249.190:46653)
0810 04:11:18.909431 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:18.909433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:18.909442 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:18.909462 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:18.909463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:18.909472 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:18.909528 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:18.910135 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:18.910582 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:18.911230 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:18.911423 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:18.911489 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:18.913749 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:18.913750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:18.913750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:18.913757 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:18.915051 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:18.915344 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:18.915345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:18.915345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:18.915392 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:18.915540 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:18.915541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:18.915541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:18.915633 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:18.915709 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:18.915792 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 04:11:18.915849 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":63,"threads_started":1}
I20260810 04:11:18.917264 13016 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:18.917433 13016 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:18.918752 13307 tablet_service.cc:1467] Processing CreateTablet for tablet 5c56747a8e1041c9a32e3a9c1639a4fb (DEFAULT_TABLE table=test-table [id=ad00e66ff5ff42d68e121d1e31d1b14a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:18.918793 13451 tablet_service.cc:1467] Processing CreateTablet for tablet 5c56747a8e1041c9a32e3a9c1639a4fb (DEFAULT_TABLE table=test-table [id=ad00e66ff5ff42d68e121d1e31d1b14a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:18.918889 13307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c56747a8e1041c9a32e3a9c1639a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:18.918910 13451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c56747a8e1041c9a32e3a9c1639a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:18.919835 13640 tablet_bootstrap.cc:492] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: Bootstrap starting.
I20260810 04:11:18.919838 13641 tablet_bootstrap.cc:492] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: Bootstrap starting.
I20260810 04:11:18.919894 13161 tablet_service.cc:1467] Processing CreateTablet for tablet 5c56747a8e1041c9a32e3a9c1639a4fb (DEFAULT_TABLE table=test-table [id=ad00e66ff5ff42d68e121d1e31d1b14a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:18.920013 13161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c56747a8e1041c9a32e3a9c1639a4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:18.920307 13641 tablet_bootstrap.cc:654] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:18.920399 13640 tablet_bootstrap.cc:654] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:18.920960 13641 tablet_bootstrap.cc:492] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: No bootstrap required, opened a new log
I20260810 04:11:18.921042 13641 ts_tablet_manager.cc:1397] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:18.921080 13640 tablet_bootstrap.cc:492] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: No bootstrap required, opened a new log
I20260810 04:11:18.921116 13640 ts_tablet_manager.cc:1397] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:18.921157 13641 raft_consensus.cc:348] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.921226 13641 raft_consensus.cc:374] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:18.921254 13641 raft_consensus.cc:729] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5acb92a864044483a42e72e0c14b14a6, State: Initialized, Role: FOLLOWER
I20260810 04:11:18.921233 13640 raft_consensus.cc:348] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.921315 13640 raft_consensus.cc:374] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:18.921340 13640 raft_consensus.cc:729] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be8f9a70e624c0cbf6a1e9530ad2f68, State: Initialized, Role: FOLLOWER
I20260810 04:11:18.921294 13641 consensus_queue.cc:260] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.921420 13641 ts_tablet_manager.cc:1428] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:18.921397 13640 consensus_queue.cc:260] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.921572 13640 ts_tablet_manager.cc:1428] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:18.921617 13644 tablet_bootstrap.cc:492] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: Bootstrap starting.
I20260810 04:11:18.922237 13644 tablet_bootstrap.cc:654] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:18.922777 13644 tablet_bootstrap.cc:492] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: No bootstrap required, opened a new log
I20260810 04:11:18.922842 13644 ts_tablet_manager.cc:1397] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:18.922950 13644 raft_consensus.cc:348] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.923026 13644 raft_consensus.cc:374] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:18.923059 13644 raft_consensus.cc:729] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af7fd140c23440e8917b3912f4a0895, State: Initialized, Role: FOLLOWER
I20260810 04:11:18.923123 13644 consensus_queue.cc:260] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.923252 13644 ts_tablet_manager.cc:1428] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:18.964839 13613 raft_consensus.cc:482] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:18.964941 13613 raft_consensus.cc:504] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.965121 13613 leader_election.cc:288] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535), 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:18.965313 13181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c56747a8e1041c9a32e3a9c1639a4fb" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7fd140c23440e8917b3912f4a0895" is_pre_election: true
I20260810 04:11:18.965312 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c56747a8e1041c9a32e3a9c1639a4fb" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" is_pre_election: true
I20260810 04:11:18.965415 13473 raft_consensus.cc:2454] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 0.
I20260810 04:11:18.965415 13181 raft_consensus.cc:2454] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 0.
I20260810 04:11:18.965564 13258 leader_election.cc:302] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5acb92a864044483a42e72e0c14b14a6, 8af7fd140c23440e8917b3912f4a0895; no voters:
I20260810 04:11:18.965677 13613 raft_consensus.cc:2781] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:18.965755 13613 raft_consensus.cc:482] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:18.965816 13613 raft_consensus.cc:3037] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:18.966535 13613 raft_consensus.cc:504] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.966661 13613 leader_election.cc:288] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 election: Requested vote from peers 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535), 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139)
I20260810 04:11:18.966864 13181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c56747a8e1041c9a32e3a9c1639a4fb" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7fd140c23440e8917b3912f4a0895"
I20260810 04:11:18.966939 13181 raft_consensus.cc:3037] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:18.966909 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c56747a8e1041c9a32e3a9c1639a4fb" candidate_uuid: "5acb92a864044483a42e72e0c14b14a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68"
I20260810 04:11:18.967001 13473 raft_consensus.cc:3037] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:18.967507 13181 raft_consensus.cc:2454] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 1.
I20260810 04:11:18.967625 13473 raft_consensus.cc:2454] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5acb92a864044483a42e72e0c14b14a6 in term 1.
I20260810 04:11:18.967667 13258 leader_election.cc:302] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5acb92a864044483a42e72e0c14b14a6, 8af7fd140c23440e8917b3912f4a0895; no voters:
I20260810 04:11:18.967788 13613 raft_consensus.cc:2781] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:18.967876 13613 raft_consensus.cc:686] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 1 LEADER]: Becoming Leader. State: Replica: 5acb92a864044483a42e72e0c14b14a6, State: Running, Role: LEADER
I20260810 04:11:18.967931 13613 consensus_queue.cc:237] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:18.968511 13014 catalog_manager.cc:5495] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130). New cstate: current_term: 1 leader_uuid: "5acb92a864044483a42e72e0c14b14a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260810 04:11:18.982095 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:18.979911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33282 (local address 127.10.249.130:37075)
0810 04:11:18.980072 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:18.980074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:18.980081 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:11:18.980100 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:18.980101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:18.980110 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:18.980175 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:18.980291 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:18.980752 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:18.981469 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:18.981653 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:18.981705 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:18.981872 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:18.981898 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:18.981935 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:18.981992 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 04:11:18.982010 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":120,"threads_started":1}
I20260810 04:11:18.984299 13473 raft_consensus.cc:1261] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Refusing update from remote peer 5acb92a864044483a42e72e0c14b14a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:18.984349 13181 raft_consensus.cc:1261] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Refusing update from remote peer 5acb92a864044483a42e72e0c14b14a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:18.984517 13605 consensus_queue.cc:1035] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:18.984606 13608 consensus_queue.cc:1035] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:18.994402 13014 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:18.994477 13014 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:18.995051 13014 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: Sending DeleteTablet for 3 replicas of tablet 5c56747a8e1041c9a32e3a9c1639a4fb
I20260810 04:11:18.995261 13161 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c56747a8e1041c9a32e3a9c1639a4fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:18 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:50222
I20260810 04:11:18.995316 13306 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c56747a8e1041c9a32e3a9c1639a4fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:18 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:33252
I20260810 04:11:18.995343 13629 tablet_replica.cc:330] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: stopping tablet replica
I20260810 04:11:18.995389 13629 raft_consensus.cc:2229] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:18.995398 13630 tablet_replica.cc:330] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: stopping tablet replica
I20260810 04:11:18.995421 13629 raft_consensus.cc:2258] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:18.995451 13630 raft_consensus.cc:2229] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:11:18.995483 13451 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c56747a8e1041c9a32e3a9c1639a4fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:18 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:41784
I20260810 04:11:18.995508 13630 raft_consensus.cc:2258] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:18.995563 13628 tablet_replica.cc:330] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: stopping tablet replica
I20260810 04:11:18.995612 13628 raft_consensus.cc:2229] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:18.995654 13628 raft_consensus.cc:2258] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:18.995604 13014 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:18.995736 13014 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:18.995788 13630 ts_tablet_manager.cc:1905] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:18.995865 13628 ts_tablet_manager.cc:1905] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:18.996039 13629 ts_tablet_manager.cc:1905] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:18.997610 13629 ts_tablet_manager.cc:1918] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:18.997717 13629 log.cc:1196] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/5c56747a8e1041c9a32e3a9c1639a4fb
I20260810 04:11:18.997977 13630 ts_tablet_manager.cc:1918] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:18.998036 13630 log.cc:1196] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/5c56747a8e1041c9a32e3a9c1639a4fb
I20260810 04:11:18.998009 13629 ts_tablet_manager.cc:1939] T 5c56747a8e1041c9a32e3a9c1639a4fb P 8af7fd140c23440e8917b3912f4a0895: Deleting consensus metadata
I20260810 04:11:18.998049 13161 tablet_service.cc:1467] Processing CreateTablet for tablet a7f5ae9c766d451780568970bf4d9961 (DEFAULT_TABLE table=test-table [id=1ff50d038d394da8b6ff9a4cb27a1b11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:18.998135 13161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7f5ae9c766d451780568970bf4d9961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:18.998153 13451 tablet_service.cc:1467] Processing CreateTablet for tablet a7f5ae9c766d451780568970bf4d9961 (DEFAULT_TABLE table=test-table [id=1ff50d038d394da8b6ff9a4cb27a1b11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:18.998255 13630 ts_tablet_manager.cc:1939] T 5c56747a8e1041c9a32e3a9c1639a4fb P 5acb92a864044483a42e72e0c14b14a6: Deleting consensus metadata
I20260810 04:11:18.998364 13451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7f5ae9c766d451780568970bf4d9961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:18.998368 13628 ts_tablet_manager.cc:1918] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:11:18.998466 13628 log.cc:1196] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/5c56747a8e1041c9a32e3a9c1639a4fb
I20260810 04:11:18.998558 13306 tablet_service.cc:1467] Processing CreateTablet for tablet a7f5ae9c766d451780568970bf4d9961 (DEFAULT_TABLE table=test-table [id=1ff50d038d394da8b6ff9a4cb27a1b11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:18.998642 13306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7f5ae9c766d451780568970bf4d9961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:18.998665 13628 ts_tablet_manager.cc:1939] T 5c56747a8e1041c9a32e3a9c1639a4fb P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting consensus metadata
I20260810 04:11:18.999382 13644 tablet_bootstrap.cc:492] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895: Bootstrap starting.
I20260810 04:11:18.999557 13640 tablet_bootstrap.cc:492] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Bootstrap starting.
I20260810 04:11:18.999713 13644 tablet_bootstrap.cc:654] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:18.999948 13640 tablet_bootstrap.cc:654] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:18.999982 13641 tablet_bootstrap.cc:492] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: Bootstrap starting.
I20260810 04:11:19.000013 13002 catalog_manager.cc:4841] TS 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139): tablet 5c56747a8e1041c9a32e3a9c1639a4fb (table test-table [id=ad00e66ff5ff42d68e121d1e31d1b14a]) successfully deleted
I20260810 04:11:19.000099 13002 catalog_manager.cc:4841] TS 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075): tablet 5c56747a8e1041c9a32e3a9c1639a4fb (table test-table [id=ad00e66ff5ff42d68e121d1e31d1b14a]) successfully deleted
I20260810 04:11:19.000275 13641 tablet_bootstrap.cc:654] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:19.000327 13002 catalog_manager.cc:4841] TS 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535): tablet 5c56747a8e1041c9a32e3a9c1639a4fb (table test-table [id=ad00e66ff5ff42d68e121d1e31d1b14a]) successfully deleted
I20260810 04:11:19.000612 13640 tablet_bootstrap.cc:492] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: No bootstrap required, opened a new log
I20260810 04:11:19.000666 13640 ts_tablet_manager.cc:1397] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:19.000828 13641 tablet_bootstrap.cc:492] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: No bootstrap required, opened a new log
I20260810 04:11:19.000828 13640 raft_consensus.cc:348] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.000881 13641 ts_tablet_manager.cc:1397] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:19.000895 13640 raft_consensus.cc:374] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:19.000917 13640 raft_consensus.cc:729] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be8f9a70e624c0cbf6a1e9530ad2f68, State: Initialized, Role: FOLLOWER
I20260810 04:11:19.000970 13640 consensus_queue.cc:260] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.000993 13641 raft_consensus.cc:348] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.001053 13641 raft_consensus.cc:374] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:19.001083 13641 raft_consensus.cc:729] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5acb92a864044483a42e72e0c14b14a6, State: Initialized, Role: FOLLOWER
I20260810 04:11:19.001085 13640 ts_tablet_manager.cc:1428] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:19.001122 13641 consensus_queue.cc:260] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.001235 13641 ts_tablet_manager.cc:1428] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:19.001309 13644 tablet_bootstrap.cc:492] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895: No bootstrap required, opened a new log
I20260810 04:11:19.001346 13644 ts_tablet_manager.cc:1397] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:19.001448 13644 raft_consensus.cc:348] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.001521 13644 raft_consensus.cc:374] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:19.001535 13644 raft_consensus.cc:729] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af7fd140c23440e8917b3912f4a0895, State: Initialized, Role: FOLLOWER
I20260810 04:11:19.001639 13644 consensus_queue.cc:260] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.001754 13644 ts_tablet_manager.cc:1428] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:19.241771 13645 raft_consensus.cc:482] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:19.241904 13645 raft_consensus.cc:504] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.242290 13645 leader_election.cc:288] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535), 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075)
I20260810 04:11:19.245116 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.242864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:57495 (local address 127.10.249.130:37075)
0810 04:11:19.242927 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:19.242929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:19.242937 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:19.242964 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:19.242964 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:19.242979 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:19.243026 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:19.243220 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.243636 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.244478 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.244801 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.244876 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.244884 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:19.245013 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 04:11:19.245051 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:11:19.245148 13658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.242694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37075 (local address 127.10.249.131:57495)
0810 04:11:19.242834 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:19.242844 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:19.242888 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:19.243049 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:19.243050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:19.243052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:19.243128 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:19.243130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.243720 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.243721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:19.244388 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:19.244390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.244876 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.244877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:19.244939 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.244942 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:19.244996 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:11:19.245032 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":83,"threads_started":1}
I20260810 04:11:19.245170 13657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.242594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:59741 (local address 127.10.249.129:36535)
0810 04:11:19.242745 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:19.242748 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:19.242760 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:11:19.242799 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:19.242800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:19.242812 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:19.242899 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:19.243258 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.243681 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.244491 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.244831 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.244908 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.244916 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:19.245052 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 04:11:19.245110 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
I20260810 04:11:19.245332 13656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.242504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36535 (local address 127.10.249.131:59741)
0810 04:11:19.242643 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:19.242654 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:19.242743 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:19.243068 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:19.243069 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:19.243071 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:19.243148 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:19.243149 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.243770 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.243771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:19.244403 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:19.244404 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.244906 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.244907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:19.244976 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.244979 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:19.245033 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:11:19.245069 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260810 04:11:19.245374 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7f5ae9c766d451780568970bf4d9961" candidate_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5acb92a864044483a42e72e0c14b14a6" is_pre_election: true
I20260810 04:11:19.245471 13323 raft_consensus.cc:2454] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0be8f9a70e624c0cbf6a1e9530ad2f68 in term 0.
I20260810 04:11:19.245569 13180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7f5ae9c766d451780568970bf4d9961" candidate_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7fd140c23440e8917b3912f4a0895" is_pre_election: true
I20260810 04:11:19.245661 13180 raft_consensus.cc:2454] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0be8f9a70e624c0cbf6a1e9530ad2f68 in term 0.
I20260810 04:11:19.245669 13405 leader_election.cc:302] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be8f9a70e624c0cbf6a1e9530ad2f68, 5acb92a864044483a42e72e0c14b14a6; no voters:
I20260810 04:11:19.245836 13645 raft_consensus.cc:2781] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:19.245898 13645 raft_consensus.cc:482] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:19.245925 13645 raft_consensus.cc:3037] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:19.246572 13645 raft_consensus.cc:504] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.246699 13645 leader_election.cc:288] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [CANDIDATE]: Term 1 election: Requested vote from peers 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535), 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075)
I20260810 04:11:19.246853 13180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7f5ae9c766d451780568970bf4d9961" candidate_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af7fd140c23440e8917b3912f4a0895"
I20260810 04:11:19.246850 13323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7f5ae9c766d451780568970bf4d9961" candidate_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5acb92a864044483a42e72e0c14b14a6"
I20260810 04:11:19.246914 13180 raft_consensus.cc:3037] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:19.246933 13323 raft_consensus.cc:3037] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:19.247462 13323 raft_consensus.cc:2454] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be8f9a70e624c0cbf6a1e9530ad2f68 in term 1.
I20260810 04:11:19.247568 13180 raft_consensus.cc:2454] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be8f9a70e624c0cbf6a1e9530ad2f68 in term 1.
I20260810 04:11:19.247664 13405 leader_election.cc:302] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be8f9a70e624c0cbf6a1e9530ad2f68, 5acb92a864044483a42e72e0c14b14a6; no voters:
I20260810 04:11:19.247807 13645 raft_consensus.cc:2781] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:19.247972 13645 raft_consensus.cc:686] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 LEADER]: Becoming Leader. State: Replica: 0be8f9a70e624c0cbf6a1e9530ad2f68, State: Running, Role: LEADER
I20260810 04:11:19.248102 13645 consensus_queue.cc:237] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } }
I20260810 04:11:19.248786 13014 catalog_manager.cc:5495] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131). New cstate: current_term: 1 leader_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be8f9a70e624c0cbf6a1e9530ad2f68" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 42139 } health_report { overall_health: HEALTHY } } }
I20260810 04:11:19.287822 13661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.285383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41786 (local address 127.10.249.131:42139)
0810 04:11:19.285550 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:19.285557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:19.285563 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:11:19.285599 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:19.285600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:19.285633 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:19.285742 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:19.285860 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.286358 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.287025 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.287240 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.287315 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.287454 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:19.287572 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:19.287660 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:19.287683 (+ 23us) server_negotiation.cc:299] Negotiation successful
0810 04:11:19.287701 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
I20260810 04:11:19.292250 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.290182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:53495 (local address 127.10.249.130:37075)
0810 04:11:19.290233 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:19.290235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:19.290367 (+ 132us) server_negotiation.cc:407] Connection header received
0810 04:11:19.290392 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:19.290393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:19.290402 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:19.290452 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:19.290553 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.290999 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.291650 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.291825 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.291873 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.292062 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:19.292088 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:19.292125 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:19.292181 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 04:11:19.292198 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:11:19.292279 13665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.290087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37075 (local address 127.10.249.131:53495)
0810 04:11:19.290296 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:19.290305 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:19.290357 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:19.290454 (+ 97us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:19.290455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:19.290457 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:19.290508 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:19.290508 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.291054 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.291054 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:19.291580 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:19.291581 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.291906 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.291907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:19.291970 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.291983 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:19.292139 (+ 156us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:19.292141 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:11:19.292178 (+ 37us) client_negotiation.cc:240] Negotiation successful
0810 04:11:19.292210 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":115,"threads_started":1}
I20260810 04:11:19.294494 13323 raft_consensus.cc:1261] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Refusing update from remote peer 0be8f9a70e624c0cbf6a1e9530ad2f68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:19.294507 13180 raft_consensus.cc:1261] T a7f5ae9c766d451780568970bf4d9961 P 8af7fd140c23440e8917b3912f4a0895 [term 1 FOLLOWER]: Refusing update from remote peer 0be8f9a70e624c0cbf6a1e9530ad2f68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:19.294837 13659 consensus_queue.cc:1035] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5acb92a864044483a42e72e0c14b14a6" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:19.294994 13645 consensus_queue.cc:1035] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8af7fd140c23440e8917b3912f4a0895" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:19.302003 13661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.299462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:42761 (local address 127.10.249.131:42139)
0810 04:11:19.299504 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:19.299506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:19.299550 (+ 44us) server_negotiation.cc:407] Connection header received
0810 04:11:19.299721 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:19.299722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:19.299731 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:19.299794 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:19.299938 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.300382 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.301276 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.301480 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.301560 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.301725 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:19.301755 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:19.301852 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:19.301918 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 04:11:19.301938 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:11:19.302034 13670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:19.299348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:42139 (local address 127.10.249.130:42761)
0810 04:11:19.299500 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:19.299511 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:19.299642 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:19.299802 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:19.299803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:19.299804 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:11:19.299863 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:19.299865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.300462 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.300464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:19.301209 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:19.301211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:19.301563 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:19.301564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:19.301627 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:19.301631 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:11:19.301855 (+ 224us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:11:19.301858 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:19.301911 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:11:19.301956 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
W20260810 04:11:19.302302 13609 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 04:11:20.825438 13014 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:20.825532 13014 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:20.826327 13014 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba601218a7d84fe1a8fa93c8865cbd59: Sending DeleteTablet for 3 replicas of tablet a7f5ae9c766d451780568970bf4d9961
I20260810 04:11:20.826542 13161 tablet_service.cc:1514] Processing DeleteTablet for tablet a7f5ae9c766d451780568970bf4d9961 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:20 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:50222
I20260810 04:11:20.826591 13306 tablet_service.cc:1514] Processing DeleteTablet for tablet a7f5ae9c766d451780568970bf4d9961 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:20 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:33252
I20260810 04:11:20.826658 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 13092
I20260810 04:11:20.827216 13696 tablet_replica.cc:330] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: stopping tablet replica
I20260810 04:11:20.827330 13696 raft_consensus.cc:2229] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:20.827440 13696 raft_consensus.cc:2258] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:20.827592 13451 tablet_service.cc:1514] Processing DeleteTablet for tablet a7f5ae9c766d451780568970bf4d9961 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:20 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:41784
I20260810 04:11:20.827754 13697 tablet_replica.cc:330] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: stopping tablet replica
I20260810 04:11:20.827811 13697 raft_consensus.cc:2229] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:11:20.827898 13697 raft_consensus.cc:2258] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:20.827906 13696 ts_tablet_manager.cc:1905] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:20.828161 13697 ts_tablet_manager.cc:1905] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:20.829821 13697 ts_tablet_manager.cc:1918] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:11:20.829885 13697 log.cc:1196] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/a7f5ae9c766d451780568970bf4d9961
I20260810 04:11:20.830106 13697 ts_tablet_manager.cc:1939] T a7f5ae9c766d451780568970bf4d9961 P 0be8f9a70e624c0cbf6a1e9530ad2f68: Deleting consensus metadata
I20260810 04:11:20.830334 13696 ts_tablet_manager.cc:1918] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:11:20.830413 13002 catalog_manager.cc:4841] TS 0be8f9a70e624c0cbf6a1e9530ad2f68 (127.10.249.131:42139): tablet a7f5ae9c766d451780568970bf4d9961 (table test-table [id=1ff50d038d394da8b6ff9a4cb27a1b11]) successfully deleted
I20260810 04:11:20.830438 13696 log.cc:1196] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/a7f5ae9c766d451780568970bf4d9961
I20260810 04:11:20.830724 13696 ts_tablet_manager.cc:1939] T a7f5ae9c766d451780568970bf4d9961 P 5acb92a864044483a42e72e0c14b14a6: Deleting consensus metadata
I20260810 04:11:20.831302 13002 catalog_manager.cc:4841] TS 5acb92a864044483a42e72e0c14b14a6 (127.10.249.130:37075): tablet a7f5ae9c766d451780568970bf4d9961 (table test-table [id=1ff50d038d394da8b6ff9a4cb27a1b11]) successfully deleted
W20260810 04:11:20.836292 13002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:36535 (error 108)
I20260810 04:11:20.836490 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 13238
I20260810 04:11:20.841351 13699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:20.841042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36535 (local address 127.0.0.1:58104)
0810 04:11:20.841238 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:20.841301 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:36535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
W20260810 04:11:20.841566 13002 catalog_manager.cc:4584] TS 8af7fd140c23440e8917b3912f4a0895 (127.10.249.129:36535): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a7f5ae9c766d451780568970bf4d9961: Network error: Client connection negotiation failed: client connection to 127.10.249.129:36535: connect: Connection refused (error 111)
I20260810 04:11:20.843012 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 13386
I20260810 04:11:20.849309 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 12983
2026-08-10T04:11:20Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5687 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:20 dist-test-slave-0kls krb5kdc[13702](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:20 dist-test-slave-0kls krb5kdc[13702](info): set up 2 sockets
Aug 10 04:11:20 dist-test-slave-0kls krb5kdc[13702](info): commencing operation
krb5kdc: starting...
W20260810 04:11:21.834179 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.964s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:21 dist-test-slave-0kls krb5kdc[13702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:21.940073 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:39993
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:39993
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:22.015533 13716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:22.015736 13716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:22.015769 13716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:22.016812 13716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:22.016870 13716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:22.016893 13716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:22.016922 13716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:22.016965 13716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:22.018465 13716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:39993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:39993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:22.018713 13716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:22.018929 13716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:22.023707 13722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:22.023862 13716 server_base.cc:1034] running on GCE node
W20260810 04:11:22.023663 13721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:22.023665 13724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:22.024253 13716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:22.024482 13716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:22.025633 13716 hybrid_clock.cc:648] HybridClock initialized: now 1786335082025614 us; error 33 us; skew 500 ppm
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[13702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:22.027904 13716 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:22.028287 13716 webserver.cc:460] Webserver started at http://127.10.249.190:35121/ using document root <none> and password file <none>
I20260810 04:11:22.028443 13716 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:22.028477 13716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:22.028554 13716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:22.029395 13716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "6be78176657d413bb3e3018721e1d461"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "838874e524ef185476de7b6b19c29c3f"
server_key_iv: "a06d4f3776998acb8293e17a44014021"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.029675 13716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "6be78176657d413bb3e3018721e1d461"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "838874e524ef185476de7b6b19c29c3f"
server_key_iv: "a06d4f3776998acb8293e17a44014021"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.030885 13716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:11:22.031472 13731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.031651 13716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:22.031734 13716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "6be78176657d413bb3e3018721e1d461"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "838874e524ef185476de7b6b19c29c3f"
server_key_iv: "a06d4f3776998acb8293e17a44014021"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.031800 13716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:22.038757 13716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:22.040761 13716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:22.040915 13716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:22.045140 13716 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:39993
I20260810 04:11:22.045210 13786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:39993 every 8 connection(s)
I20260810 04:11:22.045513 13716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:22.046449 13787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:22.048321 13787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461: Bootstrap starting.
I20260810 04:11:22.048830 13787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:22.049105 13787 log.cc:824] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:22.049739 13787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461: No bootstrap required, opened a new log
I20260810 04:11:22.051112 13787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be78176657d413bb3e3018721e1d461" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39993 } }
I20260810 04:11:22.051234 13787 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:22.051275 13787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be78176657d413bb3e3018721e1d461, State: Initialized, Role: FOLLOWER
I20260810 04:11:22.051419 13787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be78176657d413bb3e3018721e1d461" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39993 } }
I20260810 04:11:22.051491 13787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:22.051533 13787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:22.051576 13787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:22.052026 13787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be78176657d413bb3e3018721e1d461" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39993 } }
I20260810 04:11:22.052140 13787 leader_election.cc:302] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6be78176657d413bb3e3018721e1d461; no voters:
I20260810 04:11:22.052343 13787 leader_election.cc:288] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:22.052377 13790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:22.052520 13790 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [term 1 LEADER]: Becoming Leader. State: Replica: 6be78176657d413bb3e3018721e1d461, State: Running, Role: LEADER
I20260810 04:11:22.052601 13787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:22.052623 13790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be78176657d413bb3e3018721e1d461" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39993 } }
I20260810 04:11:22.053009 13791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6be78176657d413bb3e3018721e1d461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be78176657d413bb3e3018721e1d461" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39993 } } }
I20260810 04:11:22.053092 13791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:22.053141 13792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6be78176657d413bb3e3018721e1d461. Latest consensus state: current_term: 1 leader_uuid: "6be78176657d413bb3e3018721e1d461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be78176657d413bb3e3018721e1d461" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39993 } } }
I20260810 04:11:22.053243 13792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:22.053318 13798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:22.054018 13798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:22.054183 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 13716
I20260810 04:11:22.054266 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:22.054409 11238 external_mini_cluster.cc:1428] Setting key a9a25ecf0ec5327e5cf4514133e8b615
I20260810 04:11:22.055691 13798 catalog_manager.cc:1347] Generated new cluster ID: 4b043d3875a74e278610900a21cb6602
I20260810 04:11:22.055755 13798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[13702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:22.065191 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:22.054994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53218 (local address 127.10.249.190:39993)
0810 04:11:22.055152 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:22.055161 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:22.055191 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:11:22.055301 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:22.055307 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:22.055382 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:22.055530 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:22.056257 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.057449 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.058451 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.059033 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.059416 (+ 383us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:22.061716 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:22.061720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:22.061720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:22.061731 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:22.063608 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:22.063927 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:22.063929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:22.063929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:22.064009 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:22.064155 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:22.064155 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:22.064156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:22.064393 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:22.064829 (+ 436us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:22.064886 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 04:11:22.064996 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":69,"threads_started":1}
I20260810 04:11:22.069554 13798 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:22.070076 13798 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:22.073419 13798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6be78176657d413bb3e3018721e1d461: Generated new TSK 0
I20260810 04:11:22.073593 13798 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:22.106323 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39993
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:22.198957 13815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:22.199131 13815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:22.199151 13815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:22.200260 13815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:22.200302 13815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:22.200328 13815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:22.201709 13815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:22.201951 13815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:22.202205 13815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:22.206982 13820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:22.206960 13821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:22.206975 13823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:22.207115 13815 server_base.cc:1034] running on GCE node
I20260810 04:11:22.207424 13815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:22.207653 13815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:22.208807 13815 hybrid_clock.cc:648] HybridClock initialized: now 1786335082208801 us; error 33 us; skew 500 ppm
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[13702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:22.211151 13815 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:22.211604 13815 webserver.cc:460] Webserver started at http://127.10.249.129:40771/ using document root <none> and password file <none>
I20260810 04:11:22.211869 13815 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:22.211939 13815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:22.212086 13815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:22.213068 13815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "540170f630ac4e64821f3ee3a97c0265"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "8058d7683a5129213c9505443fa7e5e4"
server_key_iv: "107ad59c7c45ad6dd1ff447c0f50d69b"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.213434 13815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "540170f630ac4e64821f3ee3a97c0265"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "8058d7683a5129213c9505443fa7e5e4"
server_key_iv: "107ad59c7c45ad6dd1ff447c0f50d69b"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.214780 13815 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:11:22.215435 13830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.215592 13815 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:22.215699 13815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "540170f630ac4e64821f3ee3a97c0265"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "8058d7683a5129213c9505443fa7e5e4"
server_key_iv: "107ad59c7c45ad6dd1ff447c0f50d69b"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.215768 13815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:22.237703 13815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:22.239524 13815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:22.239678 13815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:22.239928 13815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:22.240234 13815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:22.240288 13815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.240330 13815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:22.240358 13815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.246275 13815 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:34949
I20260810 04:11:22.246315 13946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:34949 every 8 connection(s)
I20260810 04:11:22.246622 13815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:11:22.252089 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 13815
I20260810 04:11:22.252202 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:22.252417 11238 external_mini_cluster.cc:1428] Setting key aa72fd42107b030b16bf2f6e158dcfce
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[13702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:22.255966 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:22.247323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:44381 (local address 127.10.249.190:39993)
0810 04:11:22.247403 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:22.247406 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:22.247589 (+ 183us) server_negotiation.cc:407] Connection header received
0810 04:11:22.248053 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:22.248054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:22.248067 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:22.248131 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:22.248982 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.249504 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.250563 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.250776 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.250849 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:22.253147 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:22.253148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:22.253149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:22.253157 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:22.254658 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:22.255031 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:22.255032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:22.255033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:22.255093 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:22.255330 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:22.255331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:22.255332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:22.255465 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:22.255534 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:22.255805 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 04:11:22.255885 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:11:22.256181 13949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:22.247289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:39993 (local address 127.10.249.129:44381)
0810 04:11:22.247453 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:22.247495 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:22.247960 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:22.248203 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:22.248206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:22.248707 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:22.248869 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:22.248873 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.249601 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.249602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:22.250472 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:22.250474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.250860 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.250860 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:22.250975 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:22.251453 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:22.251461 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:22.253023 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:22.254743 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:22.254750 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:22.254752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:22.254957 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:22.255161 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:22.255162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:22.255162 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:22.255268 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:22.255539 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:22.255546 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:22.255669 (+ 123us) client_negotiation.cc:769] Sending connection context
0810 04:11:22.255783 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 04:11:22.255918 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260810 04:11:22.256588 13947 heartbeater.cc:347] Connected to a master server at 127.10.249.190:39993
I20260810 04:11:22.256675 13947 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:22.256851 13947 heartbeater.cc:511] Master 127.10.249.190:39993 requested a full tablet report, sending...
I20260810 04:11:22.257347 13749 ts_manager.cc:194] Registered new tserver with Master: 540170f630ac4e64821f3ee3a97c0265 (127.10.249.129:34949)
I20260810 04:11:22.258049 13749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:44381
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:22.276690 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39993
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:22.353653 13952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:22.353878 13952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:22.353904 13952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:22.354897 13952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:22.354928 13952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:22.354950 13952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:22.356123 13952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:22.356295 13952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:22.356449 13952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:22.361166 13957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:22.361205 13958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:22.361199 13960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:22.361301 13952 server_base.cc:1034] running on GCE node
I20260810 04:11:22.361533 13952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:22.361768 13952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:22.362948 13952 hybrid_clock.cc:648] HybridClock initialized: now 1786335082362925 us; error 39 us; skew 500 ppm
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[13702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:22.365197 13952 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:22.365614 13952 webserver.cc:460] Webserver started at http://127.10.249.130:46647/ using document root <none> and password file <none>
I20260810 04:11:22.365900 13952 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:22.365967 13952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:22.366091 13952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:22.367086 13952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "9d3ce06b4e9c4bd18528333626590030"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "5477515278d09fc4d272c1e71365b5f6"
server_key_iv: "e313f6aafb140bcd8126b63c9dcbcb32"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.367440 13952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "9d3ce06b4e9c4bd18528333626590030"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "5477515278d09fc4d272c1e71365b5f6"
server_key_iv: "e313f6aafb140bcd8126b63c9dcbcb32"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.368975 13952 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:11:22.369721 13968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.369904 13952 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:22.370005 13952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "9d3ce06b4e9c4bd18528333626590030"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "5477515278d09fc4d272c1e71365b5f6"
server_key_iv: "e313f6aafb140bcd8126b63c9dcbcb32"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.370087 13952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:22.384282 13952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:22.386471 13952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:22.386617 13952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:22.386821 13952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:22.387117 13952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:22.387167 13952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.387207 13952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:22.387230 13952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.392721 13952 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:40447
I20260810 04:11:22.392757 14088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:40447 every 8 connection(s)
I20260810 04:11:22.393045 13952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[13702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:22.400657 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 13952
I20260810 04:11:22.400767 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:22.400985 11238 external_mini_cluster.cc:1428] Setting key 7e5d7b7852fab5eef858ebcd394f9fdc
I20260810 04:11:22.401902 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:22.393735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:52381 (local address 127.10.249.190:39993)
0810 04:11:22.393820 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:22.393823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:22.394059 (+ 236us) server_negotiation.cc:407] Connection header received
0810 04:11:22.394478 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:22.394479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:22.394489 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:22.394535 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:22.395356 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.395804 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.396636 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.396804 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.396849 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:22.398658 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:22.398660 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:22.398660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:22.398666 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:22.399957 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:22.400294 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:22.400295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:22.400295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:22.400345 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:22.401126 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:22.401127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:22.401127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:22.401286 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:22.401355 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:22.401694 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 04:11:22.401817 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 04:11:22.402132 14091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:22.393712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:39993 (local address 127.10.249.130:52381)
0810 04:11:22.393899 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:22.393929 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:22.394399 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:22.394590 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:22.394594 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:22.395115 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:22.395287 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:22.395291 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.395876 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.395876 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:22.396569 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:22.396571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.396869 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.396870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:22.396960 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:22.397337 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:22.397344 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:22.398577 (+ 1233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:22.400026 (+ 1449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:22.400031 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:22.400033 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:22.400231 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:22.400404 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:22.400405 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:22.400405 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:22.400496 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:22.401366 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:22.401373 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:22.401540 (+ 167us) client_negotiation.cc:769] Sending connection context
0810 04:11:22.401651 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 04:11:22.401873 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":113,"threads_started":1}
I20260810 04:11:22.402567 14089 heartbeater.cc:347] Connected to a master server at 127.10.249.190:39993
I20260810 04:11:22.402680 14089 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:22.402868 14089 heartbeater.cc:511] Master 127.10.249.190:39993 requested a full tablet report, sending...
I20260810 04:11:22.403231 13749 ts_manager.cc:194] Registered new tserver with Master: 9d3ce06b4e9c4bd18528333626590030 (127.10.249.130:40447)
I20260810 04:11:22.403697 13749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:52381
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:22.426077 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39993
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:22.505352 14094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:22.505564 14094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:22.505609 14094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:22.506847 14094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:22.506916 14094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:22.506963 14094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:22.508414 14094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:22.508700 14094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:22.508926 14094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:22.513935 14104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:22.513948 14102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:22.513988 14101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:22.514117 14094 server_base.cc:1034] running on GCE node
I20260810 04:11:22.514324 14094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:22.514554 14094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:22.515707 14094 hybrid_clock.cc:648] HybridClock initialized: now 1786335082515701 us; error 30 us; skew 500 ppm
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[13702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:22.518117 14094 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:22.518575 14094 webserver.cc:460] Webserver started at http://127.10.249.131:42067/ using document root <none> and password file <none>
I20260810 04:11:22.518818 14094 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:22.518860 14094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:22.518997 14094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:22.520018 14094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "52ab673ffc8e4072ad81b489e9e1e84d"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "448c5da3c82b83f4b3f03091a7ec88f0"
server_key_iv: "e603de8fde4ec55ddb503a5e74ef4318"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.520373 14094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "52ab673ffc8e4072ad81b489e9e1e84d"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "448c5da3c82b83f4b3f03091a7ec88f0"
server_key_iv: "e603de8fde4ec55ddb503a5e74ef4318"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.521656 14094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:11:22.522410 14111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.522598 14094 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.522696 14094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "52ab673ffc8e4072ad81b489e9e1e84d"
format_stamp: "Formatted at 2026-08-10 04:11:22 on dist-test-slave-0kls"
server_key: "448c5da3c82b83f4b3f03091a7ec88f0"
server_key_iv: "e603de8fde4ec55ddb503a5e74ef4318"
server_key_version: "encryptionkey@0"
I20260810 04:11:22.522768 14094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:22.539991 14094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:22.541736 14094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:22.541920 14094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:22.542133 14094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:22.542445 14094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:22.542479 14094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.542500 14094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:22.542546 14094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:22.548168 14094 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:33395
I20260810 04:11:22.548250 14231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:33395 every 8 connection(s)
I20260810 04:11:22.548545 14094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:22.550735 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 14094
I20260810 04:11:22.550849 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:22.551016 11238 external_mini_cluster.cc:1428] Setting key 6ea67789e201a9de99da1abb8dc6a2da
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[13702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:22.557514 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:22.549241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:53795 (local address 127.10.249.190:39993)
0810 04:11:22.549315 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:22.549317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:22.549485 (+ 168us) server_negotiation.cc:407] Connection header received
0810 04:11:22.549968 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:22.549969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:22.549979 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:22.550026 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:22.550857 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.551636 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.552646 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.552864 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.552943 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:22.555115 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:22.555117 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:22.555117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:22.555125 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:22.556241 (+ 1116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:22.556620 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:22.556621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:22.556621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:22.556682 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:22.556917 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:22.556918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:22.556918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:22.557026 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:22.557093 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:22.557357 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 04:11:22.557434 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:11:22.557686 14234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:22.549219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:39993 (local address 127.10.249.131:53795)
0810 04:11:22.549370 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:22.549402 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:22.549888 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:22.550073 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:22.550076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:22.550578 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:22.550760 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:22.550765 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.551713 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.551714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:22.552550 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:22.552553 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:22.552949 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:22.552950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:22.553089 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:22.553613 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:22.553621 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:22.555024 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:22.556329 (+ 1305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:22.556336 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:22.556338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:22.556539 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:22.556749 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:22.556750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:22.556750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:22.556847 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:22.557095 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:22.557102 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:22.557227 (+ 125us) client_negotiation.cc:769] Sending connection context
0810 04:11:22.557321 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 04:11:22.557463 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":95,"threads_started":1}
I20260810 04:11:22.558195 14232 heartbeater.cc:347] Connected to a master server at 127.10.249.190:39993
I20260810 04:11:22.558295 14232 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:22.558455 14232 heartbeater.cc:511] Master 127.10.249.190:39993 requested a full tablet report, sending...
I20260810 04:11:22.558811 13749 ts_manager.cc:194] Registered new tserver with Master: 52ab673ffc8e4072ad81b489e9e1e84d (127.10.249.131:33395)
I20260810 04:11:22.559104 13749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:53795
I20260810 04:11:22.562693 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 04:11:22.575577 13810 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:11:22.574626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53220 (local address 127.10.249.190:39993)
0810 04:11:22.574708 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:22.574710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:22.574816 (+ 106us) server_negotiation.cc:407] Connection header received
0810 04:11:22.574901 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:22.574902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:22.574911 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:22.574976 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:22.575508 (+ 532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53220: BlockingRecv error: recv got EOF from 127.0.0.1:53220 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:11:22.576490 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 13815
I20260810 04:11:22.581749 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 13952
I20260810 04:11:22.588814 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 14094
I20260810 04:11:22.593329 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 13716
2026-08-10T04:11:22Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1742 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[14244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[14244](info): set up 2 sockets
Aug 10 04:11:22 dist-test-slave-0kls krb5kdc[14244](info): commencing operation
krb5kdc: starting...
W20260810 04:11:23.586047 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.973s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:23 dist-test-slave-0kls krb5kdc[14244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:23.695664 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:45091
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:45091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:23.769862 14257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:23.770027 14257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:23.770046 14257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:23.771162 14257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:23.771198 14257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:23.771212 14257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:23.771251 14257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:23.771274 14257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:23.772670 14257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:45091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:45091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:23.772902 14257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:23.773108 14257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:23.777438 14266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:23.777447 14264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:23.777446 14262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:23.777545 14257 server_base.cc:1034] running on GCE node
I20260810 04:11:23.777905 14257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:23.778157 14257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:23.779284 14257 hybrid_clock.cc:648] HybridClock initialized: now 1786335083779274 us; error 26 us; skew 500 ppm
Aug 10 04:11:23 dist-test-slave-0kls krb5kdc[14244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335083, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:23.781571 14257 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:23.782032 14257 webserver.cc:460] Webserver started at http://127.10.249.190:35605/ using document root <none> and password file <none>
I20260810 04:11:23.782218 14257 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:23.782274 14257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:23.782358 14257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:23.783263 14257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "8ade298b0a96411390d9eccfe762e524"
format_stamp: "Formatted at 2026-08-10 04:11:23 on dist-test-slave-0kls"
server_key: "7fa14c33592db26437b39e804e28d156"
server_key_iv: "7066c1b975a0a203a899239fb3ac2625"
server_key_version: "encryptionkey@0"
I20260810 04:11:23.783562 14257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "8ade298b0a96411390d9eccfe762e524"
format_stamp: "Formatted at 2026-08-10 04:11:23 on dist-test-slave-0kls"
server_key: "7fa14c33592db26437b39e804e28d156"
server_key_iv: "7066c1b975a0a203a899239fb3ac2625"
server_key_version: "encryptionkey@0"
I20260810 04:11:23.784615 14257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:23.785164 14274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:23.785305 14257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:23.785379 14257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "8ade298b0a96411390d9eccfe762e524"
format_stamp: "Formatted at 2026-08-10 04:11:23 on dist-test-slave-0kls"
server_key: "7fa14c33592db26437b39e804e28d156"
server_key_iv: "7066c1b975a0a203a899239fb3ac2625"
server_key_version: "encryptionkey@0"
I20260810 04:11:23.785427 14257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:23.799500 14257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:23.801151 14257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:23.801258 14257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:23.804929 14257 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:45091
I20260810 04:11:23.805004 14328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:45091 every 8 connection(s)
I20260810 04:11:23.805478 14257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:23.806152 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:23.808065 14329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524: Bootstrap starting.
I20260810 04:11:23.808573 14329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:23.808794 14329 log.cc:824] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:23.809342 14329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524: No bootstrap required, opened a new log
I20260810 04:11:23.809584 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 14257
I20260810 04:11:23.809652 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:23.809842 11238 external_mini_cluster.cc:1428] Setting key 558b66197307984e1d99b4aa6402fb7c
I20260810 04:11:23.811733 14329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ade298b0a96411390d9eccfe762e524" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45091 } }
I20260810 04:11:23.811883 14329 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:23.811919 14329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ade298b0a96411390d9eccfe762e524, State: Initialized, Role: FOLLOWER
I20260810 04:11:23.812027 14329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ade298b0a96411390d9eccfe762e524" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45091 } }
I20260810 04:11:23.812104 14329 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:23.812125 14329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:23.812186 14329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:23.812872 14329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ade298b0a96411390d9eccfe762e524" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45091 } }
I20260810 04:11:23.812975 14329 leader_election.cc:302] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ade298b0a96411390d9eccfe762e524; no voters:
I20260810 04:11:23.813126 14329 leader_election.cc:288] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:23.813195 14335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:23.813340 14335 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [term 1 LEADER]: Becoming Leader. State: Replica: 8ade298b0a96411390d9eccfe762e524, State: Running, Role: LEADER
I20260810 04:11:23.813361 14329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:23.813436 14335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ade298b0a96411390d9eccfe762e524" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45091 } }
I20260810 04:11:23.813762 14336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ade298b0a96411390d9eccfe762e524" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ade298b0a96411390d9eccfe762e524" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45091 } } }
I20260810 04:11:23.813879 14336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:23.813751 14335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ade298b0a96411390d9eccfe762e524. Latest consensus state: current_term: 1 leader_uuid: "8ade298b0a96411390d9eccfe762e524" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ade298b0a96411390d9eccfe762e524" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45091 } } }
I20260810 04:11:23.814080 14335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:23.814706 14344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:23.815160 14344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:23.816646 14344 catalog_manager.cc:1347] Generated new cluster ID: e2a426e0951b468dba32efa825b62668
I20260810 04:11:23.816699 14344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:23 dist-test-slave-0kls krb5kdc[14244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:23.821602 14333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:23.810300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50530 (local address 127.10.249.190:45091)
0810 04:11:23.810479 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:23.810487 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:23.810521 (+ 34us) server_negotiation.cc:407] Connection header received
0810 04:11:23.811690 (+ 1169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:23.811699 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:23.811756 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:23.811890 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:23.812581 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:23.814035 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:23.815198 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:23.815723 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:23.815818 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:23.818175 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:23.818179 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:23.818179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:23.818211 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:23.819792 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:23.820151 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:23.820154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:23.820154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:23.820252 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:23.820460 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:23.820461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:23.820461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:23.820688 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:23.821314 (+ 626us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:23.821367 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 04:11:23.821460 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260810 04:11:23.822551 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:11:23.829830 14344 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:23.830271 14344 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:23.836627 14344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ade298b0a96411390d9eccfe762e524: Generated new TSK 0
I20260810 04:11:23.836794 14344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:11:23.842466 14333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:23.838807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50540 (local address 127.10.249.190:45091)
0810 04:11:23.838847 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:23.838849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:23.838971 (+ 122us) server_negotiation.cc:407] Connection header received
0810 04:11:23.839031 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:23.839031 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:23.839040 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:23.839079 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:23.839456 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:23.840111 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:23.841195 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:23.841370 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:23.841412 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:23.842063 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:23.842064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:23.842064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:23.842221 (+ 157us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:23.842234 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:23.842239 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:23.842297 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:23.842378 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 04:11:23.842400 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:11:23.844571 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 14257
2026-08-10T04:11:23Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1251 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:23 dist-test-slave-0kls krb5kdc[14364](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:23 dist-test-slave-0kls krb5kdc[14364](info): set up 2 sockets
Aug 10 04:11:23 dist-test-slave-0kls krb5kdc[14364](info): commencing operation
krb5kdc: starting...
W20260810 04:11:24.813421 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.949s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:24 dist-test-slave-0kls krb5kdc[14364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:24.920804 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:39173
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:39173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:24.994731 14378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:24.994951 14378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:24.994983 14378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:24.995934 14378 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:24.995995 14378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:24.996016 14378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:24.996032 14378 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:24.996052 14378 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:24.997277 14378 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:39173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:39173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:24.997511 14378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:24.997711 14378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:11:25.002182 14378 server_base.cc:1034] running on GCE node
W20260810 04:11:25.002189 14384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:25.002234 14383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:25.002300 14386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:25.002712 14378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:25.003000 14378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:25.004148 14378 hybrid_clock.cc:648] HybridClock initialized: now 1786335085004134 us; error 39 us; skew 500 ppm
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:25.006404 14378 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:25.006839 14378 webserver.cc:460] Webserver started at http://127.10.249.190:34533/ using document root <none> and password file <none>
I20260810 04:11:25.007050 14378 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:25.007113 14378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:25.007262 14378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:25.008133 14378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "9b9829a717be4790af3561558e7e5d6d"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "20913536170f82b7aa56995a59d9e33d"
server_key_iv: "c0a255647e8b1021569303a079189fe2"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.008438 14378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "9b9829a717be4790af3561558e7e5d6d"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "20913536170f82b7aa56995a59d9e33d"
server_key_iv: "c0a255647e8b1021569303a079189fe2"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.009550 14378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:11:25.010221 14393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.010373 14378 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.010462 14378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "9b9829a717be4790af3561558e7e5d6d"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "20913536170f82b7aa56995a59d9e33d"
server_key_iv: "c0a255647e8b1021569303a079189fe2"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.010552 14378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:25.019248 14378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:25.020931 14378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:25.021064 14378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:25.026286 14378 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:39173
I20260810 04:11:25.026329 14449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:39173 every 8 connection(s)
I20260810 04:11:25.026695 14378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:25.027717 14450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:25.029776 14450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d: Bootstrap starting.
I20260810 04:11:25.030439 14450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:25.030714 14450 log.cc:824] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:25.031391 14450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d: No bootstrap required, opened a new log
I20260810 04:11:25.032850 14450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b9829a717be4790af3561558e7e5d6d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39173 } }
I20260810 04:11:25.032984 14450 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:25.033058 14450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b9829a717be4790af3561558e7e5d6d, State: Initialized, Role: FOLLOWER
I20260810 04:11:25.033241 14450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b9829a717be4790af3561558e7e5d6d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39173 } }
I20260810 04:11:25.033303 14450 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:25.033352 14450 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:25.033404 14450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:25.034248 14450 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b9829a717be4790af3561558e7e5d6d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39173 } }
I20260810 04:11:25.034351 14450 leader_election.cc:302] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b9829a717be4790af3561558e7e5d6d; no voters:
I20260810 04:11:25.034512 14450 leader_election.cc:288] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:25.034545 14453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:25.034704 14453 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [term 1 LEADER]: Becoming Leader. State: Replica: 9b9829a717be4790af3561558e7e5d6d, State: Running, Role: LEADER
I20260810 04:11:25.034760 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 14378
I20260810 04:11:25.034858 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:25.034765 14450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:25.034888 14453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b9829a717be4790af3561558e7e5d6d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39173 } }
I20260810 04:11:25.035015 11238 external_mini_cluster.cc:1428] Setting key 0abb1f1c3d25a89d807cb37073f3c917
I20260810 04:11:25.035523 14455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b9829a717be4790af3561558e7e5d6d. Latest consensus state: current_term: 1 leader_uuid: "9b9829a717be4790af3561558e7e5d6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b9829a717be4790af3561558e7e5d6d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39173 } } }
I20260810 04:11:25.035611 14455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:25.035539 14454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b9829a717be4790af3561558e7e5d6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b9829a717be4790af3561558e7e5d6d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 39173 } } }
I20260810 04:11:25.035876 14463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:25.035895 14454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:25.036597 14463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:25.038091 14463 catalog_manager.cc:1347] Generated new cluster ID: c2676318dffd419ca667181ef9cf4c59
I20260810 04:11:25.038141 14463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:25.046291 14464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:25.035650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39774 (local address 127.10.249.190:39173)
0810 04:11:25.036163 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:25.036173 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:25.036205 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:11:25.036309 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:25.036332 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:25.036387 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:25.036528 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:25.037420 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.038685 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.039665 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.040311 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.040422 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:25.043043 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:25.043047 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:25.043047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:25.043059 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:25.044814 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.045157 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.045159 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.045160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.045260 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.045443 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.045444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.045444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.045700 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:25.045845 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:25.045944 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 04:11:25.046056 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":101,"threads_started":1}
I20260810 04:11:25.064100 14463 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:25.064517 14463 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:25.069820 14463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b9829a717be4790af3561558e7e5d6d: Generated new TSK 0
I20260810 04:11:25.069978 14463 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:25.097255 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39173
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:25.171132 14477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:25.171326 14477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:25.171348 14477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:25.172370 14477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:25.172427 14477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:25.172453 14477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:25.173954 14477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:25.174166 14477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:25.174410 14477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:25.179075 14482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:25.179054 14485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:25.179229 14477 server_base.cc:1034] running on GCE node
W20260810 04:11:25.179270 14483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:25.179492 14477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:25.179688 14477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:25.180820 14477 hybrid_clock.cc:648] HybridClock initialized: now 1786335085180811 us; error 26 us; skew 500 ppm
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:25.183236 14477 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:25.183698 14477 webserver.cc:460] Webserver started at http://127.10.249.129:46067/ using document root <none> and password file <none>
I20260810 04:11:25.183898 14477 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:25.183957 14477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:25.184087 14477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:25.185034 14477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "a94ccc3db1d34876aa45344a4a5009ce"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "a5669bf5818feaa560e6fa12a6b68089"
server_key_iv: "b7a1623fb4523d980120c3bfdbfb93a1"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.185395 14477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "a94ccc3db1d34876aa45344a4a5009ce"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "a5669bf5818feaa560e6fa12a6b68089"
server_key_iv: "b7a1623fb4523d980120c3bfdbfb93a1"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.186982 14477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:11:25.187717 14492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.187892 14477 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:25.187995 14477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "a94ccc3db1d34876aa45344a4a5009ce"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "a5669bf5818feaa560e6fa12a6b68089"
server_key_iv: "b7a1623fb4523d980120c3bfdbfb93a1"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.188076 14477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:25.195012 14477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:25.196516 14477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:25.196668 14477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:25.196851 14477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:25.197105 14477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:25.197151 14477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.197191 14477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:25.197216 14477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.202924 14477 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:40635
I20260810 04:11:25.202970 14610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:40635 every 8 connection(s)
I20260810 04:11:25.203259 14477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:25.211298 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 14477
I20260810 04:11:25.211416 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:25.211645 14464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:25.203908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:51157 (local address 127.10.249.190:39173)
0810 04:11:25.203961 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:25.203963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:25.204128 (+ 165us) server_negotiation.cc:407] Connection header received
0810 04:11:25.204620 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:25.204621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:25.204633 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:25.204702 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:25.205554 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.206074 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.206929 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.207115 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.207160 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:25.209133 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:25.209134 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:25.209134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:25.209140 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:25.210359 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.210707 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.210708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.210709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.210758 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.210960 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.210960 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.210960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.211056 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:25.211104 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:25.211486 (+ 382us) server_negotiation.cc:299] Negotiation successful
0810 04:11:25.211588 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:11:25.211637 11238 external_mini_cluster.cc:1428] Setting key 8f4cb1dfaba5c08f4accd0388c9caaa3
I20260810 04:11:25.211809 14613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:25.203867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:39173 (local address 127.10.249.129:51157)
0810 04:11:25.204011 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:25.204048 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:25.204539 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:25.204755 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:25.204758 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:25.205300 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:25.205489 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:25.205493 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.206158 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.206159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:25.206864 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:25.206867 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.207205 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.207206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:25.207310 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:25.207775 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:25.207784 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:25.209058 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:25.210427 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:25.210434 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:25.210435 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:25.210638 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:25.210811 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:25.210812 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:25.210812 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:25.210909 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:25.211107 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:25.211125 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:25.211300 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 04:11:25.211426 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 04:11:25.211611 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260810 04:11:25.212409 14611 heartbeater.cc:347] Connected to a master server at 127.10.249.190:39173
I20260810 04:11:25.212513 14611 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:25.212700 14611 heartbeater.cc:511] Master 127.10.249.190:39173 requested a full tablet report, sending...
I20260810 04:11:25.213203 14411 ts_manager.cc:194] Registered new tserver with Master: a94ccc3db1d34876aa45344a4a5009ce (127.10.249.129:40635)
I20260810 04:11:25.213898 14411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:51157
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:25.234692 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39173
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:25.308228 14616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:25.308435 14616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:25.308470 14616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:25.309584 14616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:25.309645 14616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:25.309689 14616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:25.311079 14616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:25.311319 14616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:25.311529 14616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:25.316255 14625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:25.316346 14616 server_base.cc:1034] running on GCE node
W20260810 04:11:25.316257 14623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:25.316316 14622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:25.316634 14616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:25.316857 14616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:25.317999 14616 hybrid_clock.cc:648] HybridClock initialized: now 1786335085317989 us; error 35 us; skew 500 ppm
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:25.320343 14616 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:25.320842 14616 webserver.cc:460] Webserver started at http://127.10.249.130:39667/ using document root <none> and password file <none>
I20260810 04:11:25.321074 14616 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:25.321132 14616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:25.321267 14616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:25.322335 14616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "84d05ce24492413f9d3cdccb87a2014b"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "d1c27ecddc54a419d5434b956ca11a93"
server_key_iv: "7bcfca654de8764ab12e768c204b551b"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.322692 14616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "84d05ce24492413f9d3cdccb87a2014b"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "d1c27ecddc54a419d5434b956ca11a93"
server_key_iv: "7bcfca654de8764ab12e768c204b551b"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.323935 14616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:25.324559 14632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.324709 14616 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:25.324805 14616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "84d05ce24492413f9d3cdccb87a2014b"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "d1c27ecddc54a419d5434b956ca11a93"
server_key_iv: "7bcfca654de8764ab12e768c204b551b"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.324868 14616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:25.355692 14616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:25.357553 14616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:25.357721 14616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:25.357971 14616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:25.358289 14616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:25.358341 14616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.358383 14616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:25.358410 14616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.363869 14616 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:38009
I20260810 04:11:25.363948 14748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:38009 every 8 connection(s)
I20260810 04:11:25.364224 14616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:11:25.369481 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 14616
I20260810 04:11:25.369594 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:25.369768 11238 external_mini_cluster.cc:1428] Setting key fbe854e7f67e8e33ff6961bf468b30b9
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:25.373040 14464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:25.364871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:53925 (local address 127.10.249.190:39173)
0810 04:11:25.364934 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:25.364936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:25.365124 (+ 188us) server_negotiation.cc:407] Connection header received
0810 04:11:25.365626 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:25.365628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:25.365648 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:25.365695 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:25.366666 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.367137 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.368039 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.368239 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.368336 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:25.370541 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:25.370543 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:25.370543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:25.370550 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:25.371741 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.372091 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.372093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.372093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.372144 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.372425 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.372426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.372426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.372538 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:25.372603 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:25.372866 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 04:11:25.372950 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:11:25.373238 14751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:25.364854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:39173 (local address 127.10.249.130:53925)
0810 04:11:25.364996 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:25.365033 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:25.365499 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:25.365759 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:25.365763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:25.366378 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:25.366553 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:25.366558 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.367226 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.367227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:25.367948 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:25.367950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.368344 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.368345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:25.368476 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:25.368944 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:25.368952 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:25.370449 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:25.371818 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:25.371824 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:25.371826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:25.372024 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:25.372209 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:25.372209 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:25.372210 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:25.372334 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:25.372606 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:25.372613 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:25.372743 (+ 130us) client_negotiation.cc:769] Sending connection context
0810 04:11:25.372844 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 04:11:25.372997 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260810 04:11:25.373665 14749 heartbeater.cc:347] Connected to a master server at 127.10.249.190:39173
I20260810 04:11:25.373764 14749 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:25.373957 14749 heartbeater.cc:511] Master 127.10.249.190:39173 requested a full tablet report, sending...
I20260810 04:11:25.374339 14411 ts_manager.cc:194] Registered new tserver with Master: 84d05ce24492413f9d3cdccb87a2014b (127.10.249.130:38009)
I20260810 04:11:25.374696 14411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:53925
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:25.392565 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39173
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:25.470351 14754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:25.470552 14754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:25.470575 14754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:25.471721 14754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:25.471763 14754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:25.471810 14754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:25.473275 14754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:39173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:25.473517 14754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:25.473755 14754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:25.478663 14760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:25.478695 14763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:25.478690 14761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:25.479030 14754 server_base.cc:1034] running on GCE node
I20260810 04:11:25.479204 14754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:25.479393 14754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:25.480531 14754 hybrid_clock.cc:648] HybridClock initialized: now 1786335085480517 us; error 27 us; skew 500 ppm
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:25.482944 14754 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:25.483335 14754 webserver.cc:460] Webserver started at http://127.10.249.131:46349/ using document root <none> and password file <none>
I20260810 04:11:25.483549 14754 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:25.483601 14754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:25.483714 14754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:25.484696 14754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "725fc33ed4ad4916b8635e1462cc4e04"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "488f349c3ec7ca335e259fb060786cc6"
server_key_iv: "8d3a24663f54afeb2fb395ac288728ae"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.485034 14754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "725fc33ed4ad4916b8635e1462cc4e04"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "488f349c3ec7ca335e259fb060786cc6"
server_key_iv: "8d3a24663f54afeb2fb395ac288728ae"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.486402 14754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:11:25.487071 14771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.487246 14754 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:25.487339 14754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "725fc33ed4ad4916b8635e1462cc4e04"
format_stamp: "Formatted at 2026-08-10 04:11:25 on dist-test-slave-0kls"
server_key: "488f349c3ec7ca335e259fb060786cc6"
server_key_iv: "8d3a24663f54afeb2fb395ac288728ae"
server_key_version: "encryptionkey@0"
I20260810 04:11:25.487408 14754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:25.498776 14754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:25.500607 14754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:25.500759 14754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:25.500994 14754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:25.501312 14754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:25.501363 14754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.501406 14754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:25.501433 14754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:25.507344 14754 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:34879
I20260810 04:11:25.507390 14887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:34879 every 8 connection(s)
I20260810 04:11:25.507706 14754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:25.516342 14464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:25.508383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:55639 (local address 127.10.249.190:39173)
0810 04:11:25.508461 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:25.508464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:25.508656 (+ 192us) server_negotiation.cc:407] Connection header received
0810 04:11:25.509115 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:25.509116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:25.509125 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:25.509175 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:25.510113 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.510580 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.511547 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.511734 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.511782 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:25.514012 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:25.514014 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:25.514014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:25.514022 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:25.515114 (+ 1092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.515470 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.515472 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.515472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.515528 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.515756 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.515757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.515757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.515861 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:25.515922 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:25.516180 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 04:11:25.516257 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 04:11:25.516518 14890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:25.508332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:39173 (local address 127.10.249.131:55639)
0810 04:11:25.508512 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:25.508546 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:25.509035 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:25.509232 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:25.509236 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:25.509830 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:25.510041 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:25.510046 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.510656 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.510657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:25.511458 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:25.511460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.511801 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.511802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:25.511896 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:25.512332 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:25.512341 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:25.513909 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:25.515190 (+ 1281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:25.515196 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:25.515198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:25.515402 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:25.515586 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:25.515587 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:25.515588 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:25.515692 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:25.515924 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:25.515931 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:25.516057 (+ 126us) client_negotiation.cc:769] Sending connection context
0810 04:11:25.516159 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 04:11:25.516303 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":110,"threads_started":1}
I20260810 04:11:25.516880 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 14754
I20260810 04:11:25.516992 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:25.517046 14888 heartbeater.cc:347] Connected to a master server at 127.10.249.190:39173
I20260810 04:11:25.517165 14888 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:25.517195 11238 external_mini_cluster.cc:1428] Setting key 62a51eb614ede019740fb59a4a5246ec
I20260810 04:11:25.517347 14888 heartbeater.cc:511] Master 127.10.249.190:39173 requested a full tablet report, sending...
I20260810 04:11:25.517726 14411 ts_manager.cc:194] Registered new tserver with Master: 725fc33ed4ad4916b8635e1462cc4e04 (127.10.249.131:34879)
I20260810 04:11:25.517998 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:11:25.518174 14411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:55639
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335085, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:25.539425 14464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:25.533194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39782 (local address 127.10.249.190:39173)
0810 04:11:25.533254 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:25.533256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:25.533391 (+ 135us) server_negotiation.cc:407] Connection header received
0810 04:11:25.533435 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:25.533435 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:25.533444 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:25.533491 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:25.534095 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.534514 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.535236 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:25.535431 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:25.535485 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:25.537526 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:25.537527 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:25.537527 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:25.537533 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:25.538643 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.538909 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.538910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.538910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.538951 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:25.539071 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:25.539071 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:25.539071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:25.539166 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:25.539230 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:25.539296 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 04:11:25.539345 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260810 04:11:25.539625 14411 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39782
I20260810 04:11:25.540023 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 14477
I20260810 04:11:25.546049 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 14616
I20260810 04:11:25.551318 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 14754
I20260810 04:11:25.556006 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 14378
2026-08-10T04:11:25Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1711 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14900](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14900](info): set up 2 sockets
Aug 10 04:11:25 dist-test-slave-0kls krb5kdc[14900](info): commencing operation
krb5kdc: starting...
W20260810 04:11:26.538951 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.963s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:26 dist-test-slave-0kls krb5kdc[14900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335086, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:26.648659 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43771
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:43771
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:26.725319 14914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:26.725538 14914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:26.725574 14914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:26.726701 14914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:26.726766 14914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:26.726788 14914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:26.726817 14914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:26.726843 14914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:26.728289 14914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:43771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:26.728575 14914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:26.728801 14914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:26.733573 14920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:26.733582 14919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:26.733580 14922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:26.733903 14914 server_base.cc:1034] running on GCE node
I20260810 04:11:26.734149 14914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:26.734428 14914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:26.735586 14914 hybrid_clock.cc:648] HybridClock initialized: now 1786335086735576 us; error 38 us; skew 500 ppm
Aug 10 04:11:26 dist-test-slave-0kls krb5kdc[14900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335086, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:26.743510 14914 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:26.743940 14914 webserver.cc:460] Webserver started at http://127.10.249.190:42243/ using document root <none> and password file <none>
I20260810 04:11:26.744177 14914 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:26.744241 14914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:26.744387 14914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:26.745436 14914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "38ca71fde81846dfa38288aa9e1547fc"
format_stamp: "Formatted at 2026-08-10 04:11:26 on dist-test-slave-0kls"
server_key: "496b959e3897de77fdd0232412e378bc"
server_key_iv: "69f3edefb1bccc40521e2db4332a6198"
server_key_version: "encryptionkey@0"
I20260810 04:11:26.745822 14914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "38ca71fde81846dfa38288aa9e1547fc"
format_stamp: "Formatted at 2026-08-10 04:11:26 on dist-test-slave-0kls"
server_key: "496b959e3897de77fdd0232412e378bc"
server_key_iv: "69f3edefb1bccc40521e2db4332a6198"
server_key_version: "encryptionkey@0"
I20260810 04:11:26.747109 14914 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:11:26.747799 14930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:26.747982 14914 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:26.748066 14914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "38ca71fde81846dfa38288aa9e1547fc"
format_stamp: "Formatted at 2026-08-10 04:11:26 on dist-test-slave-0kls"
server_key: "496b959e3897de77fdd0232412e378bc"
server_key_iv: "69f3edefb1bccc40521e2db4332a6198"
server_key_version: "encryptionkey@0"
I20260810 04:11:26.748145 14914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:26.766708 14914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:26.768958 14914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:26.769127 14914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:26.773306 14914 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:43771
I20260810 04:11:26.773344 14984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:43771 every 8 connection(s)
I20260810 04:11:26.773895 14914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:26.774577 14985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:26.776866 14985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc: Bootstrap starting.
I20260810 04:11:26.777463 14985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:26.777827 14985 log.cc:824] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:26.778492 14985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc: No bootstrap required, opened a new log
I20260810 04:11:26.780052 14985 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ca71fde81846dfa38288aa9e1547fc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43771 } }
I20260810 04:11:26.780198 14985 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:26.780253 14985 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ca71fde81846dfa38288aa9e1547fc, State: Initialized, Role: FOLLOWER
I20260810 04:11:26.780401 14985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ca71fde81846dfa38288aa9e1547fc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43771 } }
I20260810 04:11:26.780483 14985 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:26.780537 14985 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:26.780584 14985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:26.781490 14985 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ca71fde81846dfa38288aa9e1547fc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43771 } }
I20260810 04:11:26.781605 14985 leader_election.cc:302] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38ca71fde81846dfa38288aa9e1547fc; no voters:
I20260810 04:11:26.781821 14985 leader_election.cc:288] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:26.781854 14988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:26.781998 14988 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [term 1 LEADER]: Becoming Leader. State: Replica: 38ca71fde81846dfa38288aa9e1547fc, State: Running, Role: LEADER
I20260810 04:11:26.782079 14985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:26.782090 14988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ca71fde81846dfa38288aa9e1547fc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43771 } }
I20260810 04:11:26.782510 14990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38ca71fde81846dfa38288aa9e1547fc. Latest consensus state: current_term: 1 leader_uuid: "38ca71fde81846dfa38288aa9e1547fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ca71fde81846dfa38288aa9e1547fc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43771 } } }
I20260810 04:11:26.782531 14989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38ca71fde81846dfa38288aa9e1547fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ca71fde81846dfa38288aa9e1547fc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43771 } } }
I20260810 04:11:26.782652 14990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:26.782651 14989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:26.782903 14997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:26.783433 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 14914
I20260810 04:11:26.783535 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:26.783746 11238 external_mini_cluster.cc:1428] Setting key 6341bfb412bdf45dd7fa090e38c95296
I20260810 04:11:26.784098 14997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:26.786067 14997 catalog_manager.cc:1347] Generated new cluster ID: 2ffcf5c808334c2897f82c5fcbd80dbe
I20260810 04:11:26.786116 14997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:26 dist-test-slave-0kls krb5kdc[14900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335086, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:26.794404 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:26.784170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47938 (local address 127.10.249.190:43771)
0810 04:11:26.784456 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:26.784466 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:26.784503 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:11:26.784613 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:26.784620 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:26.784697 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:26.784839 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:26.785612 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:26.787031 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:26.787915 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:26.788506 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:26.788616 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:26.791073 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:26.791077 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:26.791078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:26.791088 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:26.792833 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:26.793233 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:26.793235 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:26.793236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:26.793332 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:26.793533 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:26.793534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:26.793534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:26.793841 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:26.793966 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:26.794088 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 04:11:26.794209 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":74,"threads_started":1}
I20260810 04:11:26.809219 14997 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:26.809655 14997 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:26.813094 14997 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38ca71fde81846dfa38288aa9e1547fc: Generated new TSK 0
I20260810 04:11:26.813272 14997 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:26.838603 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43771
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:26.912096 15011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:26.912253 15011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:26.912274 15011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:26.913363 15011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:26.913404 15011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:26.913429 15011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:26.914834 15011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:26.915061 15011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:26.915261 15011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:26.919548 15016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:26.919518 15017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:26.919521 15019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:26.919643 15011 server_base.cc:1034] running on GCE node
I20260810 04:11:26.919960 15011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:26.920172 15011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:26.921314 15011 hybrid_clock.cc:648] HybridClock initialized: now 1786335086921280 us; error 48 us; skew 500 ppm
Aug 10 04:11:26 dist-test-slave-0kls krb5kdc[14900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335086, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:26.923820 15011 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:26.924223 15011 webserver.cc:460] Webserver started at http://127.10.249.129:36515/ using document root <none> and password file <none>
I20260810 04:11:26.924444 15011 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:26.924491 15011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:26.924649 15011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:26.925623 15011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "d501d9ed14c94c85b90017671528248d"
format_stamp: "Formatted at 2026-08-10 04:11:26 on dist-test-slave-0kls"
server_key: "8fe48b938b163a92f8e7edc39ff400be"
server_key_iv: "14e0438eb4ba80a0c73e2e0727077c94"
server_key_version: "encryptionkey@0"
I20260810 04:11:26.925981 15011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "d501d9ed14c94c85b90017671528248d"
format_stamp: "Formatted at 2026-08-10 04:11:26 on dist-test-slave-0kls"
server_key: "8fe48b938b163a92f8e7edc39ff400be"
server_key_iv: "14e0438eb4ba80a0c73e2e0727077c94"
server_key_version: "encryptionkey@0"
I20260810 04:11:26.927397 15011 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:11:26.928064 15026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:26.928213 15011 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:26.928319 15011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "d501d9ed14c94c85b90017671528248d"
format_stamp: "Formatted at 2026-08-10 04:11:26 on dist-test-slave-0kls"
server_key: "8fe48b938b163a92f8e7edc39ff400be"
server_key_iv: "14e0438eb4ba80a0c73e2e0727077c94"
server_key_version: "encryptionkey@0"
I20260810 04:11:26.928381 15011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:26.943791 15011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:26.945264 15011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:26.945397 15011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:26.945586 15011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:26.945894 15011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:26.945940 15011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:26.945976 15011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:26.946000 15011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:26.951485 15011 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:41493
I20260810 04:11:26.951545 15141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:41493 every 8 connection(s)
I20260810 04:11:26.951823 15011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:11:26.952971 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 15011
I20260810 04:11:26.953089 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:26.953253 11238 external_mini_cluster.cc:1428] Setting key a5cea1b9a13c10b8d2cdc7e9b5de2a94
Aug 10 04:11:26 dist-test-slave-0kls krb5kdc[14900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335086, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:26.961614 15144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:26.952389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43771 (local address 127.10.249.129:40205)
0810 04:11:26.952565 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:26.952616 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:26.953682 (+ 1066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:26.953947 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:26.953951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:26.954173 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:26.954323 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:26.954327 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:26.955184 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:26.955185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:26.956456 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:26.956459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:26.956848 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:26.956850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:26.956982 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:26.957408 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:26.957417 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:26.958790 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:26.960430 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:26.960436 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:26.960438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:26.960640 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:26.960846 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:26.960847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:26.960847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:26.960936 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:26.961210 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:26.961214 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:26.961308 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 04:11:26.961379 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 04:11:26.961482 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
I20260810 04:11:26.961623 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:26.952413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:40205 (local address 127.10.249.190:43771)
0810 04:11:26.952459 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:26.952461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:26.952704 (+ 243us) server_negotiation.cc:407] Connection header received
0810 04:11:26.953813 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:26.953814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:26.953825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:26.953889 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:26.954407 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:26.955095 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:26.956569 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:26.956760 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:26.956828 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:26.958877 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:26.958878 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:26.958879 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:26.958889 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:26.960355 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:26.960711 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:26.960712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:26.960712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:26.960778 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:26.960996 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:26.960997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:26.960997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:26.961136 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:26.961214 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:26.961427 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 04:11:26.961519 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
I20260810 04:11:26.962337 15142 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43771
I20260810 04:11:26.962432 15142 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:26.962632 15142 heartbeater.cc:511] Master 127.10.249.190:43771 requested a full tablet report, sending...
I20260810 04:11:26.963092 14948 ts_manager.cc:194] Registered new tserver with Master: d501d9ed14c94c85b90017671528248d (127.10.249.129:41493)
I20260810 04:11:26.963703 14948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:40205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:26.978545 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43771
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:27.049729 15147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:27.049903 15147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:27.049922 15147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:27.050943 15147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:27.050980 15147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:27.051015 15147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:27.052292 15147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:27.052445 15147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:27.052618 15147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:27.056885 15153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:27.056941 15147 server_base.cc:1034] running on GCE node
W20260810 04:11:27.056972 15154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:27.056870 15156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:27.057296 15147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:27.057554 15147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:27.058715 15147 hybrid_clock.cc:648] HybridClock initialized: now 1786335087058702 us; error 37 us; skew 500 ppm
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[14900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335087, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:27.061488 15147 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:27.061975 15147 webserver.cc:460] Webserver started at http://127.10.249.130:44817/ using document root <none> and password file <none>
I20260810 04:11:27.062134 15147 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:27.062188 15147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:27.062270 15147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:27.063162 15147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "6bbf85de888d404e8d09bc8b678c75f7"
format_stamp: "Formatted at 2026-08-10 04:11:27 on dist-test-slave-0kls"
server_key: "e7e31c3589187846c3215a637c9a2bbb"
server_key_iv: "49dbde9aa87dec626d55c56d66c48592"
server_key_version: "encryptionkey@0"
I20260810 04:11:27.063437 15147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "6bbf85de888d404e8d09bc8b678c75f7"
format_stamp: "Formatted at 2026-08-10 04:11:27 on dist-test-slave-0kls"
server_key: "e7e31c3589187846c3215a637c9a2bbb"
server_key_iv: "49dbde9aa87dec626d55c56d66c48592"
server_key_version: "encryptionkey@0"
I20260810 04:11:27.064584 15147 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:27.065127 15163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:27.065279 15147 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:27.065361 15147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "6bbf85de888d404e8d09bc8b678c75f7"
format_stamp: "Formatted at 2026-08-10 04:11:27 on dist-test-slave-0kls"
server_key: "e7e31c3589187846c3215a637c9a2bbb"
server_key_iv: "49dbde9aa87dec626d55c56d66c48592"
server_key_version: "encryptionkey@0"
I20260810 04:11:27.065420 15147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:27.108696 15147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:27.110602 15147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:27.110704 15147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:27.110848 15147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:27.111122 15147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:27.111181 15147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:27.111218 15147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:27.111243 15147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:27.116583 15147 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:36143
I20260810 04:11:27.116613 15280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:36143 every 8 connection(s)
I20260810 04:11:27.116964 15147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[14900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335087, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:27.123049 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 15147
I20260810 04:11:27.123163 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:27.123353 11238 external_mini_cluster.cc:1428] Setting key cdc9361fa332526ce90b704956b00191
I20260810 04:11:27.125681 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:27.117596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:42767 (local address 127.10.249.190:43771)
0810 04:11:27.117636 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:27.117638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:27.117830 (+ 192us) server_negotiation.cc:407] Connection header received
0810 04:11:27.118620 (+ 790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:27.118622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:27.118634 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:27.118682 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:27.119229 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.119677 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.120650 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.120862 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.120954 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:27.122888 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:27.122890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:27.122890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:27.122898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:27.124475 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:27.124817 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:27.124819 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:27.124819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:27.124880 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:27.125079 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:27.125079 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:27.125080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:27.125204 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:27.125260 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:27.125454 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 04:11:27.125555 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:11:27.125802 15283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:27.117565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43771 (local address 127.10.249.130:42767)
0810 04:11:27.117716 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:27.117746 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:27.118524 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:27.118761 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:27.118765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:27.118980 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:27.119136 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:27.119140 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.119767 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.119768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:27.120549 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:27.120550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.120963 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.120964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:27.121085 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:27.121485 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:27.121492 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:27.122797 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:27.124543 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:27.124548 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:27.124549 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:27.124752 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:27.124948 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:27.124948 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:27.124949 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:27.125028 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:27.125262 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:27.125265 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:27.125354 (+ 89us) client_negotiation.cc:769] Sending connection context
0810 04:11:27.125418 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:11:27.125510 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260810 04:11:27.126174 15281 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43771
I20260810 04:11:27.126250 15281 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:27.126411 15281 heartbeater.cc:511] Master 127.10.249.190:43771 requested a full tablet report, sending...
I20260810 04:11:27.126744 14948 ts_manager.cc:194] Registered new tserver with Master: 6bbf85de888d404e8d09bc8b678c75f7 (127.10.249.130:36143)
I20260810 04:11:27.127188 14948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:42767
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:27.147739 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43771
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:27.223835 15286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:27.224023 15286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:27.224045 15286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:27.225121 15286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:27.225168 15286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:27.225193 15286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:27.226624 15286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:27.226837 15286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:27.227035 15286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:27.231457 15292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:27.231473 15291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:27.231575 15294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:27.231714 15286 server_base.cc:1034] running on GCE node
I20260810 04:11:27.231900 15286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:27.232124 15286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:27.233278 15286 hybrid_clock.cc:648] HybridClock initialized: now 1786335087233264 us; error 38 us; skew 500 ppm
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[14900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335087, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:27.235468 15286 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:27.235827 15286 webserver.cc:460] Webserver started at http://127.10.249.131:33577/ using document root <none> and password file <none>
I20260810 04:11:27.236076 15286 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:27.236140 15286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:27.236275 15286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:27.237221 15286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "aafd08ffb7be4ec6a8a93833831e06fa"
format_stamp: "Formatted at 2026-08-10 04:11:27 on dist-test-slave-0kls"
server_key: "0f8b7ca9649191374be9d00088a429d8"
server_key_iv: "9618eeda892e8821efe0863110cd4578"
server_key_version: "encryptionkey@0"
I20260810 04:11:27.237567 15286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "aafd08ffb7be4ec6a8a93833831e06fa"
format_stamp: "Formatted at 2026-08-10 04:11:27 on dist-test-slave-0kls"
server_key: "0f8b7ca9649191374be9d00088a429d8"
server_key_iv: "9618eeda892e8821efe0863110cd4578"
server_key_version: "encryptionkey@0"
I20260810 04:11:27.238902 15286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:27.239533 15302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:27.239681 15286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:27.239780 15286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "aafd08ffb7be4ec6a8a93833831e06fa"
format_stamp: "Formatted at 2026-08-10 04:11:27 on dist-test-slave-0kls"
server_key: "0f8b7ca9649191374be9d00088a429d8"
server_key_iv: "9618eeda892e8821efe0863110cd4578"
server_key_version: "encryptionkey@0"
I20260810 04:11:27.239873 15286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:27.254954 15286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:27.256577 15286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:27.256722 15286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:27.256920 15286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:27.257207 15286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:27.257256 15286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:27.257297 15286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:27.257323 15286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:27.263036 15286 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:42053
I20260810 04:11:27.263070 15420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:42053 every 8 connection(s)
I20260810 04:11:27.263383 15286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[14900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335087, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:27.271528 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:27.264021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:40343 (local address 127.10.249.190:43771)
0810 04:11:27.264074 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:27.264076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:27.264251 (+ 175us) server_negotiation.cc:407] Connection header received
0810 04:11:27.265102 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:27.265103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:27.265117 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:27.265184 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:27.265763 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.266292 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.267240 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.267441 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.267520 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:27.269375 (+ 1855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:27.269376 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:27.269377 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:27.269383 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:27.270591 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:27.270893 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:27.270894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:27.270894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:27.270937 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:27.271107 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:27.271108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:27.271108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:27.271198 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:27.271239 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:27.271422 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 04:11:27.271473 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:11:27.271672 15424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:27.264008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43771 (local address 127.10.249.131:40343)
0810 04:11:27.264148 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:27.264180 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:27.264998 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:27.265245 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:27.265248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:27.265481 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:27.265646 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:27.265650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.266390 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.266391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:27.267151 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:27.267153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.267532 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.267533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:27.267645 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:27.268061 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:27.268069 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:27.269298 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:27.270658 (+ 1360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:27.270663 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:27.270664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:27.270841 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:27.270985 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:27.270986 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:27.270986 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:27.271065 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:27.271241 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:27.271245 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:27.271334 (+ 89us) client_negotiation.cc:769] Sending connection context
0810 04:11:27.271400 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:11:27.271492 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":75,"threads_started":1}
I20260810 04:11:27.272116 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 15286
I20260810 04:11:27.272148 15421 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43771
I20260810 04:11:27.272228 15421 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:27.272231 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:27.272377 11238 external_mini_cluster.cc:1428] Setting key 25a156834ebbbb1d61c3fa2aa28e03f2
I20260810 04:11:27.272377 15421 heartbeater.cc:511] Master 127.10.249.190:43771 requested a full tablet report, sending...
I20260810 04:11:27.272805 14947 ts_manager.cc:194] Registered new tserver with Master: aafd08ffb7be4ec6a8a93833831e06fa (127.10.249.131:42053)
I20260810 04:11:27.273238 14947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:40343
I20260810 04:11:27.273289 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[14900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[14900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:27.293663 15429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:27.287330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53192 (local address 127.10.249.129:41493)
0810 04:11:27.287465 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:27.287469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:27.287477 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:27.287501 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:27.287502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:27.287513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:27.287580 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:27.288044 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.288631 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.289250 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.289518 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.289583 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:27.291339 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:27.291346 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:27.291347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:27.291353 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:27.292478 (+ 1125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:27.292848 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:27.292850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:27.292851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:27.292918 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:27.293108 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:27.293109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:27.293109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:27.293251 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:27.293387 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:27.293467 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 04:11:27.293538 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":53,"threads_started":1}
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[14900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:27.300225 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:27.294866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47942 (local address 127.10.249.190:43771)
0810 04:11:27.294942 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:27.294944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:27.294974 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:11:27.295038 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:27.295039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:27.295047 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:27.295085 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:27.295515 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.295907 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.296461 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:27.296630 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:27.296695 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:27.298470 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:27.298471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:27.298471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:27.298477 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:27.299449 (+ 972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:27.299714 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:27.299715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:27.299715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:27.299769 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:27.299897 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:27.299898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:27.299898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:27.299996 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:27.300052 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:27.300125 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 04:11:27.300175 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260810 04:11:27.300441 14947 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47942
I20260810 04:11:27.300750 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 15011
I20260810 04:11:27.306685 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 15147
I20260810 04:11:27.312485 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 15286
I20260810 04:11:27.317276 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 14914
2026-08-10T04:11:27Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1761 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[15434](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[15434](info): set up 2 sockets
Aug 10 04:11:27 dist-test-slave-0kls krb5kdc[15434](info): commencing operation
krb5kdc: starting...
W20260810 04:11:28.321650 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.984s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:28 dist-test-slave-0kls krb5kdc[15434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:28.432276 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:36849
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:36849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:28.509721 15448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:28.509920 15448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:28.509939 15448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:28.511003 15448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:28.511042 15448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:28.511055 15448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:28.511104 15448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:28.511130 15448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:28.512542 15448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:36849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:36849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:28.512790 15448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:28.513007 15448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:28.517490 15454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:28.517496 15453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:28.517503 15456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:28.517915 15448 server_base.cc:1034] running on GCE node
I20260810 04:11:28.518098 15448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:28.518348 15448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:28.519484 15448 hybrid_clock.cc:648] HybridClock initialized: now 1786335088519474 us; error 27 us; skew 500 ppm
Aug 10 04:11:28 dist-test-slave-0kls krb5kdc[15434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335088, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:28.521910 15448 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:28.522251 15448 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:28.522297 15448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:28.522436 15448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:28.523451 15448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "4f544a3ac3bf13a635ca3832031793d7"
server_key_iv: "0d76814a2490ff80aa4db1c1f1c855bc"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.523813 15448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "4f544a3ac3bf13a635ca3832031793d7"
server_key_iv: "0d76814a2490ff80aa4db1c1f1c855bc"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.525056 15448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:28.525740 15462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:28.525959 15448 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:28.526042 15448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "4f544a3ac3bf13a635ca3832031793d7"
server_key_iv: "0d76814a2490ff80aa4db1c1f1c855bc"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.526096 15448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:28.532931 15448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:28.535033 15448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:28.535136 15448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:28.539014 15448 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:36849
I20260810 04:11:28.539062 15515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:36849 every 8 connection(s)
I20260810 04:11:28.539327 15448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:28.540335 15516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:28.542618 15516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd: Bootstrap starting.
I20260810 04:11:28.543226 15516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:28.543519 15516 log.cc:824] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:28.544157 15516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd: No bootstrap required, opened a new log
I20260810 04:11:28.545603 15516 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36849 } }
I20260810 04:11:28.545753 15516 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:28.545841 15516 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d18c9159ff40c8b1454ad1cd63cdfd, State: Initialized, Role: FOLLOWER
I20260810 04:11:28.545979 15516 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36849 } }
I20260810 04:11:28.546052 15516 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:28.546093 15516 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:28.546150 15516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:28.546907 15516 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36849 } }
I20260810 04:11:28.547019 15516 leader_election.cc:302] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8d18c9159ff40c8b1454ad1cd63cdfd; no voters:
I20260810 04:11:28.547057 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 15448
I20260810 04:11:28.547153 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:28.547212 15516 leader_election.cc:288] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:28.547238 15519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:28.547369 11238 external_mini_cluster.cc:1428] Setting key 657e6010e995398c1fe01218293db9fd
I20260810 04:11:28.547369 15519 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [term 1 LEADER]: Becoming Leader. State: Replica: e8d18c9159ff40c8b1454ad1cd63cdfd, State: Running, Role: LEADER
I20260810 04:11:28.547478 15516 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:28.547461 15519 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36849 } }
I20260810 04:11:28.547887 15519 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8d18c9159ff40c8b1454ad1cd63cdfd. Latest consensus state: current_term: 1 leader_uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36849 } } }
I20260810 04:11:28.547988 15519 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:28.547894 15520 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8d18c9159ff40c8b1454ad1cd63cdfd" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36849 } } }
I20260810 04:11:28.548169 15520 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:28.548317 15530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:28.548831 15530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:28.550624 15530 catalog_manager.cc:1347] Generated new cluster ID: 8f828e4223544fbf8163b7cb3176cdda
I20260810 04:11:28.550674 15530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:28 dist-test-slave-0kls krb5kdc[15434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:28.559268 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:28.547970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38664 (local address 127.10.249.190:36849)
0810 04:11:28.549439 (+ 1469us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:28.549448 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:28.549481 (+ 33us) server_negotiation.cc:407] Connection header received
0810 04:11:28.549563 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:28.549568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:28.549611 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:28.549714 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:28.550449 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.551820 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.552861 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.553451 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.553548 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:28.556056 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:28.556060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:28.556060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:28.556071 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:28.557764 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:28.558132 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:28.558135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:28.558135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:28.558242 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:28.558420 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:28.558421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:28.558421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:28.558736 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:28.558888 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:28.558949 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 04:11:28.559063 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1425,"thread_start_us":75,"threads_started":1}
I20260810 04:11:28.569525 15530 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:28.570299 15530 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:28.578276 15530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd: Generated new TSK 0
I20260810 04:11:28.578477 15530 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:28.608330 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36849
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:28.684625 15543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:28.684798 15543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:28.684818 15543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:28.685951 15543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:28.685989 15543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:28.686039 15543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:28.687386 15543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:28.687595 15543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:28.687793 15543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:28.692246 15551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:28.692252 15549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:28.692358 15543 server_base.cc:1034] running on GCE node
W20260810 04:11:28.692246 15548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:28.692636 15543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:28.692875 15543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:28.694003 15543 hybrid_clock.cc:648] HybridClock initialized: now 1786335088693989 us; error 35 us; skew 500 ppm
Aug 10 04:11:28 dist-test-slave-0kls krb5kdc[15434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335088, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:28.696182 15543 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:28.696463 15543 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:28.696522 15543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:28.696650 15543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:28.697501 15543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "12ca475df95e4fc98a579fb2442b1306"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "d09edee39147d33fdf8e23979ea9820a"
server_key_iv: "c97720ce8e154f3e4c8c80c5850be7be"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.697898 15543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "12ca475df95e4fc98a579fb2442b1306"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "d09edee39147d33fdf8e23979ea9820a"
server_key_iv: "c97720ce8e154f3e4c8c80c5850be7be"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.699124 15543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:28.699733 15558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:28.699911 15543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:28.700001 15543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "12ca475df95e4fc98a579fb2442b1306"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "d09edee39147d33fdf8e23979ea9820a"
server_key_iv: "c97720ce8e154f3e4c8c80c5850be7be"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.700068 15543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:28.713101 15543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:28.714949 15543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:28.715082 15543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:28.715271 15543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:28.715548 15543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:28.715598 15543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:28.715636 15543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:28.715659 15543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:28.721134 15543 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:44345
I20260810 04:11:28.721199 15672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:44345 every 8 connection(s)
I20260810 04:11:28.721419 15543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:11:28.722815 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 15543
I20260810 04:11:28.722931 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:28.723133 11238 external_mini_cluster.cc:1428] Setting key fab4f4c9bb6df915f5a409bdb483a820
Aug 10 04:11:28 dist-test-slave-0kls krb5kdc[15434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335088, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:28.730939 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:28.722084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:39949 (local address 127.10.249.190:36849)
0810 04:11:28.722122 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:28.722124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:28.722289 (+ 165us) server_negotiation.cc:407] Connection header received
0810 04:11:28.722822 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:28.722823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:28.722834 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:28.722873 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:28.724113 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.724542 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.725706 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.726031 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.726095 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:28.727965 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:28.727967 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:28.727968 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:28.727976 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:28.729509 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:28.730046 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:28.730048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:28.730048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:28.730124 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:28.730355 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:28.730356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:28.730356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:28.730476 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:28.730548 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:28.730763 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 04:11:28.730844 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:11:28.730955 15676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:28.722045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:36849 (local address 127.10.249.129:39949)
0810 04:11:28.722187 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:28.722223 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:28.722709 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:28.722961 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:28.722967 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:28.723319 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:28.724024 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:28.724031 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.724622 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.724623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:28.725623 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:28.725626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.726113 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.726114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:28.726210 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:28.726613 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:28.726626 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:28.727886 (+ 1260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:28.729705 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:28.729711 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:28.729713 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:28.729976 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:28.730199 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:28.730199 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:28.730200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:28.730300 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:28.730550 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:28.730554 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:28.730647 (+ 93us) client_negotiation.cc:769] Sending connection context
0810 04:11:28.730718 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 04:11:28.730817 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
I20260810 04:11:28.731415 15673 heartbeater.cc:347] Connected to a master server at 127.10.249.190:36849
I20260810 04:11:28.731498 15673 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
I20260810 04:11:28.731643 15673 heartbeater.cc:511] Master 127.10.249.190:36849 requested a full tablet report, sending...
I20260810 04:11:28.732113 15479 ts_manager.cc:194] Registered new tserver with Master: 12ca475df95e4fc98a579fb2442b1306 (127.10.249.129:44345)
I20260810 04:11:28.732697 15479 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:39949
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:28.746656 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36849
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:28.822011 15679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:28.822211 15679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:28.822242 15679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:28.823352 15679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:28.823412 15679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:28.823455 15679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:28.824819 15679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:28.825039 15679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:28.825240 15679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:28.829504 15685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:28.829571 15684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:28.829567 15687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:28.829928 15679 server_base.cc:1034] running on GCE node
I20260810 04:11:28.830104 15679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:28.830277 15679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:28.831399 15679 hybrid_clock.cc:648] HybridClock initialized: now 1786335088831390 us; error 24 us; skew 500 ppm
Aug 10 04:11:28 dist-test-slave-0kls krb5kdc[15434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335088, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:28.833549 15679 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:28.833957 15679 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:28.834020 15679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:28.834149 15679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:28.835027 15679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "012eb23486d34497ae0b6f725cc9f82e"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "1b4e85e3f5be579cd1300d404b7d16a3"
server_key_iv: "7d81950b9659177171676cca457e4a2d"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.835364 15679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "012eb23486d34497ae0b6f725cc9f82e"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "1b4e85e3f5be579cd1300d404b7d16a3"
server_key_iv: "7d81950b9659177171676cca457e4a2d"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.836493 15679 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:28.837114 15694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:28.837287 15679 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:28.837371 15679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "012eb23486d34497ae0b6f725cc9f82e"
format_stamp: "Formatted at 2026-08-10 04:11:28 on dist-test-slave-0kls"
server_key: "1b4e85e3f5be579cd1300d404b7d16a3"
server_key_iv: "7d81950b9659177171676cca457e4a2d"
server_key_version: "encryptionkey@0"
I20260810 04:11:28.837440 15679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:28.890669 15679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:28.892452 15679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:28.892639 15679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:28.892899 15679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:28.893242 15679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:28.893299 15679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:28.893347 15679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:28.893381 15679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:28.899195 15679 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:46601
I20260810 04:11:28.899227 15813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:46601 every 8 connection(s)
I20260810 04:11:28.899487 15679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:11:28.901712 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 15679
I20260810 04:11:28.901858 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:28.902027 11238 external_mini_cluster.cc:1428] Setting key 3164afc9df947db6fb1a276a61573c89
Aug 10 04:11:28 dist-test-slave-0kls krb5kdc[15434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335088, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:28.909336 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:28.900211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:52035 (local address 127.10.249.190:36849)
0810 04:11:28.900297 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:28.900299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:28.900458 (+ 159us) server_negotiation.cc:407] Connection header received
0810 04:11:28.901023 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:28.901025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:28.901039 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:28.901096 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:28.902098 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.902691 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.904297 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.904580 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.904659 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:28.906647 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:28.906648 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:28.906649 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:28.906657 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:28.907982 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:28.908377 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:28.908379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:28.908379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:28.908441 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:28.908699 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:28.908700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:28.908700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:28.908828 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:28.908903 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:28.909159 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 04:11:28.909248 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 04:11:28.909500 15816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:28.900124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:36849 (local address 127.10.249.130:52035)
0810 04:11:28.900327 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:28.900372 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:28.900884 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:28.901159 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:28.901163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:28.901419 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:28.901995 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:28.902002 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.902806 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.902807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:28.904221 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:28.904226 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:28.904671 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:28.904672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:28.904767 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:28.905230 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:28.905238 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:28.906553 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:28.908078 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:28.908085 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:28.908087 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:28.908293 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:28.908523 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:28.908524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:28.908524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:28.908627 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:28.908893 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:28.908899 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:28.909035 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 04:11:28.909137 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 04:11:28.909281 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":91,"threads_started":1}
I20260810 04:11:28.909967 15814 heartbeater.cc:347] Connected to a master server at 127.10.249.190:36849
I20260810 04:11:28.910055 15814 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:28.910207 15814 heartbeater.cc:511] Master 127.10.249.190:36849 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
I20260810 04:11:28.910609 15479 ts_manager.cc:194] Registered new tserver with Master: 012eb23486d34497ae0b6f725cc9f82e (127.10.249.130:46601)
I20260810 04:11:28.910952 15479 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:52035
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:28.926517 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36849
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:28.999759 15819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:29.000000 15819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:29.000056 15819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:29.001134 15819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:29.001187 15819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:29.001232 15819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:29.002568 15819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:29.002832 15819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:29.003048 15819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:29.007618 15824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.007601 15826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.007617 15829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:29.007797 15819 server_base.cc:1034] running on GCE node
I20260810 04:11:29.008018 15819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:29.008235 15819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:29.009443 15819 hybrid_clock.cc:648] HybridClock initialized: now 1786335089009415 us; error 28 us; skew 500 ppm
Aug 10 04:11:29 dist-test-slave-0kls krb5kdc[15434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335089, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:29.012053 15819 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:29.012442 15819 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:29.012508 15819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:29.012655 15819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:29.013621 15819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "3b0fab23783342fa8b3da48b5952bcab"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "81ba07f496a5b7260eec27da4e66e33c"
server_key_iv: "c8fa9829d7cd55dcfd4ecbf6ecaf52c6"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.013998 15819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "3b0fab23783342fa8b3da48b5952bcab"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "81ba07f496a5b7260eec27da4e66e33c"
server_key_iv: "c8fa9829d7cd55dcfd4ecbf6ecaf52c6"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.015218 15819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:11:29.015836 15835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.015983 15819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:29.016074 15819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "3b0fab23783342fa8b3da48b5952bcab"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "81ba07f496a5b7260eec27da4e66e33c"
server_key_iv: "c8fa9829d7cd55dcfd4ecbf6ecaf52c6"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.016144 15819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:29.029691 15819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:29.031810 15819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:29.031955 15819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:29.032169 15819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:29.032454 15819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:29.032502 15819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.032534 15819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:29.032558 15819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.037962 15819 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:35463
I20260810 04:11:29.038000 15955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:35463 every 8 connection(s)
I20260810 04:11:29.038260 15819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:29.040529 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 15819
I20260810 04:11:29.040702 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:29.040920 11238 external_mini_cluster.cc:1428] Setting key ab902ddebc8f9d0c24c60df0644cc916
Aug 10 04:11:29 dist-test-slave-0kls krb5kdc[15434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335089, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:29.046468 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.038863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:52013 (local address 127.10.249.190:36849)
0810 04:11:29.038923 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.038924 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.039110 (+ 186us) server_negotiation.cc:407] Connection header received
0810 04:11:29.039578 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.039579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.039592 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.039646 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.040574 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.041298 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.042351 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.042507 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.042555 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.044365 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.044366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.044366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:29.044372 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.045385 (+ 1013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:29.045700 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:29.045701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:29.045701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:29.045748 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:29.045983 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:29.045984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:29.045984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:29.046092 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.046142 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.046341 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.046411 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:11:29.046597 15958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.038844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:36849 (local address 127.10.249.131:52013)
0810 04:11:29.039006 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.039040 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.039476 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.039728 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.039731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.039996 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.040468 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.040473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.041390 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.041392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.042277 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.042280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.042562 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.042562 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.042664 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.043051 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:29.043058 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.044295 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.045448 (+ 1153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:29.045453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:29.045455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:29.045643 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:29.045845 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:29.045846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:29.045846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:29.045934 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:29.046143 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.046146 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.046243 (+ 97us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.046317 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.046428 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260810 04:11:29.046968 15956 heartbeater.cc:347] Connected to a master server at 127.10.249.190:36849
I20260810 04:11:29.047066 15956 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:29.047230 15956 heartbeater.cc:511] Master 127.10.249.190:36849 requested a full tablet report, sending...
I20260810 04:11:29.047622 15479 ts_manager.cc:194] Registered new tserver with Master: 3b0fab23783342fa8b3da48b5952bcab (127.10.249.131:35463)
I20260810 04:11:29.048005 15479 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:52013
I20260810 04:11:29.052421 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:11:29.059062 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.053763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38670 (local address 127.10.249.190:36849)
0810 04:11:29.053842 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.053844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.053949 (+ 105us) server_negotiation.cc:407] Connection header received
0810 04:11:29.054017 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.054017 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.054027 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.054094 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.054605 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.055073 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.055786 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.055954 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.056015 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.056968 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.056969 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.056969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:29.056976 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.058009 (+ 1033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:29.058336 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:29.058337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:29.058338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:29.058390 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:29.058569 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:29.058570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:29.058570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:29.058702 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.058798 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.058909 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.058974 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:11:29.060521 15479 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:29.062049 15479 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:29.068529 15964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.064190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:35463 (local address 127.0.0.1:60546)
0810 04:11:29.064419 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.064454 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.064514 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.064730 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.064733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.064734 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:29.064788 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.064789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.066111 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.066112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.067336 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.067339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.068251 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.068252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.068340 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.068354 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.068414 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.068461 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":48,"threads_started":1}
I20260810 04:11:29.068801 15966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.064207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:44345 (local address 127.0.0.1:46382)
0810 04:11:29.064638 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.064645 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.064671 (+ 26us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.064918 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.064919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.064920 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:29.064943 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.064943 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.066240 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.066241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.067513 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.067515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.068606 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.068607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.068657 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.068661 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.068703 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.068736 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"mutex_wait_us":62,"thread_start_us":49,"threads_started":1}
I20260810 04:11:29.068816 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.064332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60546 (local address 127.10.249.131:35463)
0810 04:11:29.064496 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.064501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.064510 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:29.064622 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.064624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.064639 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.064721 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:29.064830 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.066001 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.067431 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.068096 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.068162 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.068213 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.068698 (+ 485us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.068742 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":80,"threads_started":1}
I20260810 04:11:29.069370 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.064192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46601 (local address 127.0.0.1:40094)
0810 04:11:29.064546 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.064554 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.064589 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.066154 (+ 1565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.066156 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.066158 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:29.066200 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.066201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.067377 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.067378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.068347 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.068350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.069200 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.069201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.069254 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.069258 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.069284 (+ 26us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.069316 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":46,"threads_started":1}
I20260810 04:11:29.069445 15887 tablet_service.cc:1467] Processing CreateTablet for tablet 62ac6c55383a45d1a75a4e7afcafdf79 (DEFAULT_TABLE table=test-table [id=3819df2ba115474aa6cb6941a39f9158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:29.069669 15968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.064419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.10.249.130:46601)
0810 04:11:29.064578 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.064583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.064593 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:29.064650 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.064651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.064666 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.066153 (+ 1487us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:29.066277 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.067276 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.068444 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.069115 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.069478 (+ 363us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.069540 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.069563 (+ 23us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.069600 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":66,"threads_started":1}
I20260810 04:11:29.069800 15887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62ac6c55383a45d1a75a4e7afcafdf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:29.070025 15969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.064404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46382 (local address 127.10.249.129:44345)
0810 04:11:29.064789 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.064792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.064800 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:29.064830 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.064832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.064844 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.064916 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:29.064996 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.066033 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.067602 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.068475 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.068531 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.068575 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.068953 (+ 378us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.068990 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":81,"threads_started":1}
I20260810 04:11:29.070386 15746 tablet_service.cc:1467] Processing CreateTablet for tablet 62ac6c55383a45d1a75a4e7afcafdf79 (DEFAULT_TABLE table=test-table [id=3819df2ba115474aa6cb6941a39f9158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:29.070566 15607 tablet_service.cc:1467] Processing CreateTablet for tablet 62ac6c55383a45d1a75a4e7afcafdf79 (DEFAULT_TABLE table=test-table [id=3819df2ba115474aa6cb6941a39f9158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:29.070701 15746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62ac6c55383a45d1a75a4e7afcafdf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:29.070863 15607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62ac6c55383a45d1a75a4e7afcafdf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:29.072973 15970 tablet_bootstrap.cc:492] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: Bootstrap starting.
I20260810 04:11:29.073351 15971 tablet_bootstrap.cc:492] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306: Bootstrap starting.
I20260810 04:11:29.073864 15970 tablet_bootstrap.cc:654] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:29.073848 15972 tablet_bootstrap.cc:492] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Bootstrap starting.
I20260810 04:11:29.074047 15971 tablet_bootstrap.cc:654] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:29.074467 15972 tablet_bootstrap.cc:654] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:29.074678 15971 log.cc:824] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:29.074792 15970 log.cc:824] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:29.075098 15972 log.cc:824] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:29.075456 15971 tablet_bootstrap.cc:492] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306: No bootstrap required, opened a new log
I20260810 04:11:29.075543 15971 ts_tablet_manager.cc:1397] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:11:29.075771 15972 tablet_bootstrap.cc:492] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: No bootstrap required, opened a new log
I20260810 04:11:29.075835 15972 ts_tablet_manager.cc:1397] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:11:29.077381 15971 raft_consensus.cc:348] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.077554 15971 raft_consensus.cc:374] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:29.077621 15971 raft_consensus.cc:729] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ca475df95e4fc98a579fb2442b1306, State: Initialized, Role: FOLLOWER
I20260810 04:11:29.077600 15972 raft_consensus.cc:348] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.077741 15972 raft_consensus.cc:374] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:29.077731 15971 consensus_queue.cc:260] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.077800 15972 raft_consensus.cc:729] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 012eb23486d34497ae0b6f725cc9f82e, State: Initialized, Role: FOLLOWER
I20260810 04:11:29.077906 15972 consensus_queue.cc:260] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.078038 15971 ts_tablet_manager.cc:1428] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:29.078063 15673 heartbeater.cc:503] Master 127.10.249.190:36849 was elected leader, sending a full tablet report...
I20260810 04:11:29.078168 15972 ts_tablet_manager.cc:1428] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260810 04:11:29.078271 15814 heartbeater.cc:503] Master 127.10.249.190:36849 was elected leader, sending a full tablet report...
I20260810 04:11:29.078725 15970 tablet_bootstrap.cc:492] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: No bootstrap required, opened a new log
I20260810 04:11:29.078811 15970 ts_tablet_manager.cc:1397] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260810 04:11:29.080224 15970 raft_consensus.cc:348] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.080338 15970 raft_consensus.cc:374] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:29.080358 15970 raft_consensus.cc:729] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b0fab23783342fa8b3da48b5952bcab, State: Initialized, Role: FOLLOWER
I20260810 04:11:29.080459 15970 consensus_queue.cc:260] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.080713 15970 ts_tablet_manager.cc:1428] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:11:29.080745 15956 heartbeater.cc:503] Master 127.10.249.190:36849 was elected leader, sending a full tablet report...
W20260810 04:11:29.150022 15815 tablet.cc:2369] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:11:29.157321 15978 raft_consensus.cc:482] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:29.157413 15978 raft_consensus.cc:504] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.157763 15978 leader_election.cc:288] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b0fab23783342fa8b3da48b5952bcab (127.10.249.131:35463), 12ca475df95e4fc98a579fb2442b1306 (127.10.249.129:44345)
I20260810 04:11:29.160369 15816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.157938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:44345 (local address 127.10.249.130:51937)
0810 04:11:29.157997 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.158008 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.158044 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.158241 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.158243 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.158244 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:29.158311 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.158313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.158892 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.158893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.159568 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.159570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.160112 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.160113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.160196 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.160199 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.160261 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.160298 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 04:11:29.160369 15969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.158056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:51937 (local address 127.10.249.129:44345)
0810 04:11:29.158124 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.158126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.158131 (+ 5us) server_negotiation.cc:407] Connection header received
0810 04:11:29.158153 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.158154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.158175 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.158226 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:29.158378 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.158818 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.159674 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.160036 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.160114 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.160124 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.160269 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.160306 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 04:11:29.160465 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.158025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:48489 (local address 127.10.249.131:35463)
0810 04:11:29.158073 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.158075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.158221 (+ 146us) server_negotiation.cc:407] Connection header received
0810 04:11:29.158272 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.158273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.158281 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.158335 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:29.158477 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.158898 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.159757 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.160131 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.160218 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.160225 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.160369 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.160402 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 04:11:29.160583 15980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.157938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:35463 (local address 127.10.249.130:48489)
0810 04:11:29.158153 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.158161 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.158219 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.158348 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.158349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.158351 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:29.158416 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.158418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.158972 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.158973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.159648 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:29.159649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.160218 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.160219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:29.160296 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.160299 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.160361 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.160397 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":59,"thread_start_us":105,"threads_started":1}
I20260810 04:11:29.160797 15627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62ac6c55383a45d1a75a4e7afcafdf79" candidate_uuid: "012eb23486d34497ae0b6f725cc9f82e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12ca475df95e4fc98a579fb2442b1306" is_pre_election: true
I20260810 04:11:29.160985 15627 raft_consensus.cc:2454] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 012eb23486d34497ae0b6f725cc9f82e in term 0.
I20260810 04:11:29.160951 15908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62ac6c55383a45d1a75a4e7afcafdf79" candidate_uuid: "012eb23486d34497ae0b6f725cc9f82e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0fab23783342fa8b3da48b5952bcab" is_pre_election: true
I20260810 04:11:29.161075 15908 raft_consensus.cc:2454] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 012eb23486d34497ae0b6f725cc9f82e in term 0.
I20260810 04:11:29.161197 15696 leader_election.cc:302] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 012eb23486d34497ae0b6f725cc9f82e, 12ca475df95e4fc98a579fb2442b1306; no voters:
I20260810 04:11:29.161329 15978 raft_consensus.cc:2781] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:29.161396 15978 raft_consensus.cc:482] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:29.161427 15978 raft_consensus.cc:3037] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:29.162113 15978 raft_consensus.cc:504] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.162240 15978 leader_election.cc:288] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [CANDIDATE]: Term 1 election: Requested vote from peers 3b0fab23783342fa8b3da48b5952bcab (127.10.249.131:35463), 12ca475df95e4fc98a579fb2442b1306 (127.10.249.129:44345)
I20260810 04:11:29.162385 15908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62ac6c55383a45d1a75a4e7afcafdf79" candidate_uuid: "012eb23486d34497ae0b6f725cc9f82e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0fab23783342fa8b3da48b5952bcab"
I20260810 04:11:29.162379 15627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62ac6c55383a45d1a75a4e7afcafdf79" candidate_uuid: "012eb23486d34497ae0b6f725cc9f82e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12ca475df95e4fc98a579fb2442b1306"
I20260810 04:11:29.162449 15627 raft_consensus.cc:3037] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:29.162462 15908 raft_consensus.cc:3037] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:29.163160 15627 raft_consensus.cc:2454] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 012eb23486d34497ae0b6f725cc9f82e in term 1.
I20260810 04:11:29.163182 15908 raft_consensus.cc:2454] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 012eb23486d34497ae0b6f725cc9f82e in term 1.
I20260810 04:11:29.163355 15696 leader_election.cc:302] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 012eb23486d34497ae0b6f725cc9f82e, 12ca475df95e4fc98a579fb2442b1306; no voters:
I20260810 04:11:29.163461 15978 raft_consensus.cc:2781] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:29.163604 15978 raft_consensus.cc:686] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 1 LEADER]: Becoming Leader. State: Replica: 012eb23486d34497ae0b6f725cc9f82e, State: Running, Role: LEADER
I20260810 04:11:29.163836 15978 consensus_queue.cc:237] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } }
I20260810 04:11:29.164587 15479 catalog_manager.cc:5495] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e reported cstate change: term changed from 0 to 1, leader changed from <none> to 012eb23486d34497ae0b6f725cc9f82e (127.10.249.130). New cstate: current_term: 1 leader_uuid: "012eb23486d34497ae0b6f725cc9f82e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "012eb23486d34497ae0b6f725cc9f82e" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46601 } health_report { overall_health: HEALTHY } } }
I20260810 04:11:29.185082 15968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.182860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40102 (local address 127.10.249.130:46601)
0810 04:11:29.182906 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.182908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.182917 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:29.182955 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.182956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.182972 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.183044 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:29.183198 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.183623 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.184355 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:29.184531 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:29.184591 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:29.184748 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:29.184838 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:29.184916 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.184953 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.184988 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:11:29.186667 15627 raft_consensus.cc:1261] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 1 FOLLOWER]: Refusing update from remote peer 012eb23486d34497ae0b6f725cc9f82e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:29.186671 15908 raft_consensus.cc:1261] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 1 FOLLOWER]: Refusing update from remote peer 012eb23486d34497ae0b6f725cc9f82e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:29.186992 15978 consensus_queue.cc:1035] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ca475df95e4fc98a579fb2442b1306" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 44345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:29.187105 15981 consensus_queue.cc:1035] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b0fab23783342fa8b3da48b5952bcab" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 35463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:29.190119 15986 mvcc.cc:205] Tried to move back new op lower bound from 7316828525306347520 to 7316828525215670272. Current Snapshot: MvccSnapshot[applied={T|T < 7316828525306347520}]
I20260810 04:11:29.191351 15478 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:29.191437 15478 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:29.192176 15478 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8d18c9159ff40c8b1454ad1cd63cdfd: Sending DeleteTablet for 3 replicas of tablet 62ac6c55383a45d1a75a4e7afcafdf79
I20260810 04:11:29.192485 15746 tablet_service.cc:1514] Processing DeleteTablet for tablet 62ac6c55383a45d1a75a4e7afcafdf79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:29 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:40094
I20260810 04:11:29.192545 15607 tablet_service.cc:1514] Processing DeleteTablet for tablet 62ac6c55383a45d1a75a4e7afcafdf79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:29 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:46382
I20260810 04:11:29.192746 15887 tablet_service.cc:1514] Processing DeleteTablet for tablet 62ac6c55383a45d1a75a4e7afcafdf79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:29 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:60546
I20260810 04:11:29.192806 15994 tablet_replica.cc:330] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306: stopping tablet replica
I20260810 04:11:29.192946 15994 raft_consensus.cc:2229] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:29.193013 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 15543
I20260810 04:11:29.193053 15993 tablet_replica.cc:330] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: stopping tablet replica
I20260810 04:11:29.193143 15994 raft_consensus.cc:2258] T 62ac6c55383a45d1a75a4e7afcafdf79 P 12ca475df95e4fc98a579fb2442b1306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:29.193228 15993 raft_consensus.cc:2229] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:11:29.193641 15993 raft_consensus.cc:2258] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:29.194113 15993 ts_tablet_manager.cc:1905] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:29.195724 15993 ts_tablet_manager.cc:1918] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:29.195819 15993 log.cc:1196] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/62ac6c55383a45d1a75a4e7afcafdf79
I20260810 04:11:29.196055 15993 ts_tablet_manager.cc:1939] T 62ac6c55383a45d1a75a4e7afcafdf79 P 012eb23486d34497ae0b6f725cc9f82e: Deleting consensus metadata
I20260810 04:11:29.196448 15466 catalog_manager.cc:4841] TS 012eb23486d34497ae0b6f725cc9f82e (127.10.249.130:46601): tablet 62ac6c55383a45d1a75a4e7afcafdf79 (table test-table [id=3819df2ba115474aa6cb6941a39f9158]) successfully deleted
I20260810 04:11:29.197897 15996 tablet_replica.cc:330] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: stopping tablet replica
I20260810 04:11:29.198022 15996 raft_consensus.cc:2229] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:29.198156 15996 raft_consensus.cc:2258] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:29.198545 15996 ts_tablet_manager.cc:1905] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:29.199802 15996 ts_tablet_manager.cc:1918] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:29.199924 15996 log.cc:1196] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/62ac6c55383a45d1a75a4e7afcafdf79
I20260810 04:11:29.200220 15996 ts_tablet_manager.cc:1939] T 62ac6c55383a45d1a75a4e7afcafdf79 P 3b0fab23783342fa8b3da48b5952bcab: Deleting consensus metadata
I20260810 04:11:29.200598 15463 catalog_manager.cc:4841] TS 3b0fab23783342fa8b3da48b5952bcab (127.10.249.131:35463): tablet 62ac6c55383a45d1a75a4e7afcafdf79 (table test-table [id=3819df2ba115474aa6cb6941a39f9158]) successfully deleted
W20260810 04:11:29.201680 15464 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:44345 (error 108)
I20260810 04:11:29.201967 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 15679
I20260810 04:11:29.202605 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.202025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:44345 (local address 127.0.0.1:46396)
0810 04:11:29.202527 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.202563 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:44345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483}
W20260810 04:11:29.202925 15464 catalog_manager.cc:4584] TS 12ca475df95e4fc98a579fb2442b1306 (127.10.249.129:44345): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 62ac6c55383a45d1a75a4e7afcafdf79: Network error: Client connection negotiation failed: client connection to 127.10.249.129:44345: connect: Connection refused (error 111)
I20260810 04:11:29.209937 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 15819
I20260810 04:11:29.214656 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 15448
2026-08-10T04:11:29Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1897 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T04:11:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:29Z Disabled control of system clock
I20260810 04:11:29.242079 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42255
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:40757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:42255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 04:11:29.315866 16001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:29.316066 16001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:29.316097 16001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:29.317080 16001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:29.317133 16001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:29.317152 16001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:29.317168 16001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:29.317196 16001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:29.318451 16001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:42255
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:29.318675 16001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:29.318905 16001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:29.323510 16007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.323551 16009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.323542 16006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:29.323779 16001 server_base.cc:1034] running on GCE node
I20260810 04:11:29.324002 16001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:29.324245 16001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:29.325376 16001 hybrid_clock.cc:648] HybridClock initialized: now 1786335089325367 us; error 28 us; skew 500 ppm
I20260810 04:11:29.326581 16001 webserver.cc:460] Webserver started at http://127.10.249.190:41607/ using document root <none> and password file <none>
I20260810 04:11:29.326747 16001 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:29.326805 16001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:29.326902 16001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:29.327787 16001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "34c0f71926eb4d8a9ba1ac567b5dff95"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "b7914a69af58541266d4372c83bf27af"
server_key_iv: "99e23e347df44d144a492b28b86f328f"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.328090 16001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "34c0f71926eb4d8a9ba1ac567b5dff95"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "b7914a69af58541266d4372c83bf27af"
server_key_iv: "99e23e347df44d144a492b28b86f328f"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.329301 16001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:29.330003 16016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.330183 16001 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:29.330277 16001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "34c0f71926eb4d8a9ba1ac567b5dff95"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "b7914a69af58541266d4372c83bf27af"
server_key_iv: "99e23e347df44d144a492b28b86f328f"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.330353 16001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:29.333524 16001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:29.333781 16001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:29.333947 16001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:29.337944 16001 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:42255
I20260810 04:11:29.338052 16070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:42255 every 8 connection(s)
I20260810 04:11:29.338371 16001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:29.339005 16071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:29.341719 16071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95: Bootstrap starting.
I20260810 04:11:29.342344 16071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:29.342613 16071 log.cc:824] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:29.343235 16071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95: No bootstrap required, opened a new log
I20260810 04:11:29.344779 16071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c0f71926eb4d8a9ba1ac567b5dff95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42255 } }
I20260810 04:11:29.344903 16071 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:29.344925 16071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c0f71926eb4d8a9ba1ac567b5dff95, State: Initialized, Role: FOLLOWER
I20260810 04:11:29.345026 16071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c0f71926eb4d8a9ba1ac567b5dff95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42255 } }
I20260810 04:11:29.345074 16071 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:29.345109 16071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:29.345140 16071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:29.345600 16071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c0f71926eb4d8a9ba1ac567b5dff95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42255 } }
I20260810 04:11:29.345706 16071 leader_election.cc:302] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34c0f71926eb4d8a9ba1ac567b5dff95; no voters:
I20260810 04:11:29.345841 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 16001
I20260810 04:11:29.345947 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:29.345944 16071 leader_election.cc:288] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:29.345988 16074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:29.346177 16074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [term 1 LEADER]: Becoming Leader. State: Replica: 34c0f71926eb4d8a9ba1ac567b5dff95, State: Running, Role: LEADER
I20260810 04:11:29.346187 11238 external_mini_cluster.cc:1428] Setting key 9dbb604385727e384cfe1d06a9950d85
I20260810 04:11:29.346254 16071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:29.346266 16074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c0f71926eb4d8a9ba1ac567b5dff95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42255 } }
I20260810 04:11:29.346951 16075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34c0f71926eb4d8a9ba1ac567b5dff95. Latest consensus state: current_term: 1 leader_uuid: "34c0f71926eb4d8a9ba1ac567b5dff95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c0f71926eb4d8a9ba1ac567b5dff95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42255 } } }
I20260810 04:11:29.347088 16075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:29.347203 16076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34c0f71926eb4d8a9ba1ac567b5dff95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c0f71926eb4d8a9ba1ac567b5dff95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42255 } } }
I20260810 04:11:29.347330 16076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:29.347631 16085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:29.348093 16085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:29.349031 16081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.346794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45664 (local address 127.10.249.190:42255)
0810 04:11:29.347635 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.347645 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.347682 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:11:29.347799 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.347806 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.347851 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.347996 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.348596 (+ 600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.348600 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.348600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.348604 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.348642 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.348654 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.348724 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.348796 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.348847 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":63,"threads_started":1}
I20260810 04:11:29.350112 16085 catalog_manager.cc:1347] Generated new cluster ID: 09fb8dfc089e4219a4a52779787e5ed6
I20260810 04:11:29.350157 16085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:11:29.357249 16085 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:29.357424 16085 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:29.359468 16085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95: Generated new TSK 0
I20260810 04:11:29.359654 16085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:11:29.364149 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42255
--builtin_ntp_servers=127.10.249.148:40757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 04:11:29.442898 16095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:29.443082 16095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:29.443104 16095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:29.444195 16095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:29.444229 16095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:29.444252 16095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:29.445576 16095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:29.445818 16095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:29.446139 16095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:29.450953 16100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.451068 16104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.451184 16102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:29.451373 16095 server_base.cc:1034] running on GCE node
I20260810 04:11:29.451537 16095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:29.451761 16095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:29.452899 16095 hybrid_clock.cc:648] HybridClock initialized: now 1786335089452886 us; error 32 us; skew 500 ppm
I20260810 04:11:29.454272 16095 webserver.cc:460] Webserver started at http://127.10.249.129:46435/ using document root <none> and password file <none>
I20260810 04:11:29.454512 16095 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:29.454558 16095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:29.454687 16095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:29.455717 16095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "a36b161cdec74eb0ac32989b97329988"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "860fcd8d5be650f965d2a50e80238565"
server_key_iv: "c979299893f3a6468eac5c6da80f3327"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.456055 16095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "a36b161cdec74eb0ac32989b97329988"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "860fcd8d5be650f965d2a50e80238565"
server_key_iv: "c979299893f3a6468eac5c6da80f3327"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.457427 16095 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:29.458316 16110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.458556 16095 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:11:29.458655 16095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "a36b161cdec74eb0ac32989b97329988"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "860fcd8d5be650f965d2a50e80238565"
server_key_iv: "c979299893f3a6468eac5c6da80f3327"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.458750 16095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:29.462224 16095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:29.462469 16095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:29.462595 16095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:29.462817 16095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:29.463176 16095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:29.463233 16095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.463275 16095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:29.463301 16095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.470331 16095 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:39187
I20260810 04:11:29.470405 16228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:39187 every 8 connection(s)
I20260810 04:11:29.470707 16095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:11:29.474184 16081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.471487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:38257 (local address 127.10.249.190:42255)
0810 04:11:29.471559 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.471561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.471868 (+ 307us) server_negotiation.cc:407] Connection header received
0810 04:11:29.472499 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.472500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.472506 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.472548 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.473929 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.473930 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.473930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.473934 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.473947 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.473951 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.473996 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.474098 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.474128 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:11:29.474392 16231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.471461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:42255 (local address 127.10.249.129:38257)
0810 04:11:29.471705 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.471761 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.472400 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.472629 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.472633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.472661 (+ 28us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.473713 (+ 1052us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:11:29.473713 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.473751 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:11:29.473832 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.474019 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.474025 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.474028 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.474095 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.474177 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":98,"threads_started":1}
I20260810 04:11:29.474987 16229 heartbeater.cc:347] Connected to a master server at 127.10.249.190:42255
I20260810 04:11:29.475090 16229 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:29.475234 16229 heartbeater.cc:511] Master 127.10.249.190:42255 requested a full tablet report, sending...
I20260810 04:11:29.475730 16033 ts_manager.cc:194] Registered new tserver with Master: a36b161cdec74eb0ac32989b97329988 (127.10.249.129:39187)
I20260810 04:11:29.479066 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 16095
I20260810 04:11:29.479166 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:29.479333 11238 external_mini_cluster.cc:1428] Setting key ac25e7a771cc7ad34ff88f24aa09af4f
I20260810 04:11:29.480240 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42255
--builtin_ntp_servers=127.10.249.148:40757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 04:11:29.556969 16232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:29.557175 16232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:29.557209 16232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:29.558255 16232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:29.558311 16232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:29.558350 16232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:29.559520 16232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:29.559762 16232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:29.560066 16232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:29.564961 16237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.564985 16239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.564985 16241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:29.565165 16232 server_base.cc:1034] running on GCE node
I20260810 04:11:29.565404 16232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:29.565650 16232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:29.566802 16232 hybrid_clock.cc:648] HybridClock initialized: now 1786335089566843 us; error 105 us; skew 500 ppm
I20260810 04:11:29.568017 16232 webserver.cc:460] Webserver started at http://127.10.249.130:37065/ using document root <none> and password file <none>
I20260810 04:11:29.568253 16232 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:29.568316 16232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:29.568459 16232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:29.569388 16232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "0b054c8905098037a91b8be796dfe895"
server_key_iv: "7a11ee2728ab44b285bb2fb148724efa"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.569725 16232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "0b054c8905098037a91b8be796dfe895"
server_key_iv: "7a11ee2728ab44b285bb2fb148724efa"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.570981 16232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:11:29.571601 16247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.571770 16232 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:29.571859 16232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "0b054c8905098037a91b8be796dfe895"
server_key_iv: "7a11ee2728ab44b285bb2fb148724efa"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.571933 16232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:29.575150 16232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:29.575387 16232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:29.575511 16232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:29.575699 16232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:29.575973 16232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:29.576021 16232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.576056 16232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:29.576081 16232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.581544 16232 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:33385
I20260810 04:11:29.581609 16365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:33385 every 8 connection(s)
I20260810 04:11:29.581934 16232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:11:29.584764 16081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.582677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:54831 (local address 127.10.249.190:42255)
0810 04:11:29.582735 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.582738 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.582983 (+ 245us) server_negotiation.cc:407] Connection header received
0810 04:11:29.583397 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.583398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.583404 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.583456 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.584513 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.584514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.584515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.584519 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.584535 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.584540 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.584593 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.584665 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.584680 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:11:29.584978 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.582685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:42255 (local address 127.10.249.130:54831)
0810 04:11:29.582872 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.582904 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.583316 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.583502 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.583505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.583512 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.584353 (+ 841us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:11:29.584354 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.584397 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:11:29.584424 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.584589 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.584593 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.584596 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.584665 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.584743 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260810 04:11:29.585139 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 16232
I20260810 04:11:29.585246 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:29.585421 11238 external_mini_cluster.cc:1428] Setting key 212f66a32f23aa1d8331a1cdbcf5c2bf
I20260810 04:11:29.585421 16366 heartbeater.cc:347] Connected to a master server at 127.10.249.190:42255
I20260810 04:11:29.585505 16366 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:29.585650 16366 heartbeater.cc:511] Master 127.10.249.190:42255 requested a full tablet report, sending...
I20260810 04:11:29.586040 16033 ts_manager.cc:194] Registered new tserver with Master: fcdfbfed1f6c4062b6105ef63b4f6e1d (127.10.249.130:33385)
I20260810 04:11:29.586428 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42255
--builtin_ntp_servers=127.10.249.148:40757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 04:11:29.665450 16369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:29.665689 16369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:29.665738 16369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:29.666869 16369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:29.666924 16369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:29.666961 16369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:29.668269 16369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:29.668525 16369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:29.668802 16369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:29.673499 16377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:29.673501 16375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:29.673686 16369 server_base.cc:1034] running on GCE node
W20260810 04:11:29.673564 16374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:29.674015 16369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:29.674237 16369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:29.675366 16369 hybrid_clock.cc:648] HybridClock initialized: now 1786335089675355 us; error 28 us; skew 500 ppm
I20260810 04:11:29.676544 16369 webserver.cc:460] Webserver started at http://127.10.249.131:39845/ using document root <none> and password file <none>
I20260810 04:11:29.676766 16369 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:29.676829 16369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:29.676955 16369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:29.677907 16369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "ea06b1986bd548519088efa03d80c3dc"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "0831084a780225245a00ab3abcc16b6e"
server_key_iv: "5b514a5595295472326ce8ff1154895b"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.678241 16369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "ea06b1986bd548519088efa03d80c3dc"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "0831084a780225245a00ab3abcc16b6e"
server_key_iv: "5b514a5595295472326ce8ff1154895b"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.679508 16369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:29.680190 16384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.680430 16369 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:29.680531 16369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "ea06b1986bd548519088efa03d80c3dc"
format_stamp: "Formatted at 2026-08-10 04:11:29 on dist-test-slave-0kls"
server_key: "0831084a780225245a00ab3abcc16b6e"
server_key_iv: "5b514a5595295472326ce8ff1154895b"
server_key_version: "encryptionkey@0"
I20260810 04:11:29.680599 16369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:29.683933 16369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:29.684157 16369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:29.684293 16369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:29.684473 16369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:29.684738 16369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:29.684783 16369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.684819 16369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:29.684844 16369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:29.689826 16369 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:36969
I20260810 04:11:29.689868 16503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:36969 every 8 connection(s)
I20260810 04:11:29.690137 16369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:29.691215 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 16369
I20260810 04:11:29.691315 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:29.691464 11238 external_mini_cluster.cc:1428] Setting key 221b226052280f0e702a811096eb4144
I20260810 04:11:29.692912 16081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.690789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:37079 (local address 127.10.249.190:42255)
0810 04:11:29.690828 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.690830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.691046 (+ 216us) server_negotiation.cc:407] Connection header received
0810 04:11:29.691499 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.691500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.691515 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.691561 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.692741 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.692742 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.692742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.692746 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.692759 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.692763 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.692806 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.692850 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.692861 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:11:29.693109 16506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.690763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:42255 (local address 127.10.249.131:37079)
0810 04:11:29.690935 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.690962 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.691390 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.691617 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.691620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.691628 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.692615 (+ 987us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:11:29.692616 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.692642 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:11:29.692667 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.692805 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.692807 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.692809 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.692857 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.692901 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260810 04:11:29.693544 16504 heartbeater.cc:347] Connected to a master server at 127.10.249.190:42255
I20260810 04:11:29.693626 16504 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:29.693727 16504 heartbeater.cc:511] Master 127.10.249.190:42255 requested a full tablet report, sending...
I20260810 04:11:29.694087 16033 ts_manager.cc:194] Registered new tserver with Master: ea06b1986bd548519088efa03d80c3dc (127.10.249.131:36969)
I20260810 04:11:29.703096 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:11:29.705289 16081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.704334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45676 (local address 127.10.249.190:42255)
0810 04:11:29.704396 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.704398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.704504 (+ 106us) server_negotiation.cc:407] Connection header received
0810 04:11:29.704565 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.704566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.704570 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.704627 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.705106 (+ 479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.705107 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.705108 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.705111 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.705124 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.705128 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.705173 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.705214 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.705228 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:11:29.706691 16033 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45676:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:29.708123 16033 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:29.711509 16512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.710157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:36969 (local address 127.0.0.1:51676)
0810 04:11:29.710250 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.710285 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.710333 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.710566 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.710573 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.710579 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.711025 (+ 446us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:11:29.711025 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.711041 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:11:29.711062 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.711312 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.711335 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.711338 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.711404 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.711418 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":84,"threads_started":1}
I20260810 04:11:29.711910 16514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.710301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51676 (local address 127.10.249.131:36969)
0810 04:11:29.710443 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.710447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.710455 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:29.710477 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.710478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.710484 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.710562 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.711123 (+ 561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.711130 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.711131 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.711134 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.711168 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.711187 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.711299 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.711804 (+ 505us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.711817 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260810 04:11:29.712193 16513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.710159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:39187 (local address 127.0.0.1:36356)
0810 04:11:29.710285 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.710295 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.710344 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.711065 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.711066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.711069 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.711715 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:11:29.711715 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.711721 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:11:29.711731 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.712045 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.712046 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.712047 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.712100 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.712114 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":42,"threads_started":1}
I20260810 04:11:29.712240 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.711013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33536 (local address 127.10.249.130:33385)
0810 04:11:29.711227 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.711232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.711241 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:29.711264 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.711266 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.711274 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.711378 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.711878 (+ 500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.711885 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.711885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.711889 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.711922 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.711947 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.712017 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.712141 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.712158 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":91,"threads_started":1}
I20260810 04:11:29.712472 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.710492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36356 (local address 127.10.249.129:39187)
0810 04:11:29.710632 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.710637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.710647 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:29.710673 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.710675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.710684 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.710758 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.711810 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.711820 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.711820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.711825 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.711866 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.711897 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.711957 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.712380 (+ 423us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.712397 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":75,"threads_started":1}
I20260810 04:11:29.712195 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.710333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:33385 (local address 127.0.0.1:33536)
0810 04:11:29.710455 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.710464 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.710497 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.711383 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.711384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.711386 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.711751 (+ 365us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:11:29.711752 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.711777 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:11:29.711792 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.712069 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.712069 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.712070 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.712121 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.712131 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":84,"threads_started":1}
I20260810 04:11:29.712507 16433 tablet_service.cc:1467] Processing CreateTablet for tablet 807046ee467c48d39e8ba7f4358da1b0 (DEFAULT_TABLE table=test-table [id=7d8196e02f274c1b98eab6cfbaae2251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:29.712853 16433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 807046ee467c48d39e8ba7f4358da1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:29.713289 16297 tablet_service.cc:1467] Processing CreateTablet for tablet 807046ee467c48d39e8ba7f4358da1b0 (DEFAULT_TABLE table=test-table [id=7d8196e02f274c1b98eab6cfbaae2251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:29.713366 16161 tablet_service.cc:1467] Processing CreateTablet for tablet 807046ee467c48d39e8ba7f4358da1b0 (DEFAULT_TABLE table=test-table [id=7d8196e02f274c1b98eab6cfbaae2251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:29.713605 16297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 807046ee467c48d39e8ba7f4358da1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:29.713721 16161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 807046ee467c48d39e8ba7f4358da1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:29.716107 16518 tablet_bootstrap.cc:492] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d: Bootstrap starting.
I20260810 04:11:29.716684 16518 tablet_bootstrap.cc:654] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:29.716961 16520 tablet_bootstrap.cc:492] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988: Bootstrap starting.
I20260810 04:11:29.717008 16518 log.cc:824] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:29.717080 16519 tablet_bootstrap.cc:492] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: Bootstrap starting.
I20260810 04:11:29.717597 16520 tablet_bootstrap.cc:654] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:29.717710 16519 tablet_bootstrap.cc:654] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:29.717823 16518 tablet_bootstrap.cc:492] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d: No bootstrap required, opened a new log
I20260810 04:11:29.717897 16518 ts_tablet_manager.cc:1397] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:29.717953 16520 log.cc:824] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:29.718076 16519 log.cc:824] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:29.718793 16519 tablet_bootstrap.cc:492] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: No bootstrap required, opened a new log
I20260810 04:11:29.718870 16519 ts_tablet_manager.cc:1397] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:11:29.719034 16520 tablet_bootstrap.cc:492] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988: No bootstrap required, opened a new log
I20260810 04:11:29.719103 16520 ts_tablet_manager.cc:1397] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:11:29.720605 16518 raft_consensus.cc:348] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.720769 16518 raft_consensus.cc:374] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:29.720809 16518 raft_consensus.cc:729] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcdfbfed1f6c4062b6105ef63b4f6e1d, State: Initialized, Role: FOLLOWER
I20260810 04:11:29.720810 16519 raft_consensus.cc:348] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.721005 16519 raft_consensus.cc:374] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:29.720960 16518 consensus_queue.cc:260] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.721046 16519 raft_consensus.cc:729] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea06b1986bd548519088efa03d80c3dc, State: Initialized, Role: FOLLOWER
I20260810 04:11:29.721154 16519 consensus_queue.cc:260] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.721248 16518 ts_tablet_manager.cc:1428] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:11:29.721388 16519 ts_tablet_manager.cc:1428] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 04:11:29.721459 16366 heartbeater.cc:503] Master 127.10.249.190:42255 was elected leader, sending a full tablet report...
I20260810 04:11:29.721565 16504 heartbeater.cc:503] Master 127.10.249.190:42255 was elected leader, sending a full tablet report...
I20260810 04:11:29.722075 16520 raft_consensus.cc:348] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.722242 16520 raft_consensus.cc:374] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:29.722291 16520 raft_consensus.cc:729] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a36b161cdec74eb0ac32989b97329988, State: Initialized, Role: FOLLOWER
I20260810 04:11:29.722386 16520 consensus_queue.cc:260] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.722626 16520 ts_tablet_manager.cc:1428] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260810 04:11:29.722743 16229 heartbeater.cc:503] Master 127.10.249.190:42255 was elected leader, sending a full tablet report...
W20260810 04:11:29.832572 16367 tablet.cc:2369] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:11:29.876672 16525 raft_consensus.cc:482] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:29.876775 16525 raft_consensus.cc:504] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.877074 16525 leader_election.cc:288] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a36b161cdec74eb0ac32989b97329988 (127.10.249.129:39187), fcdfbfed1f6c4062b6105ef63b4f6e1d (127.10.249.130:33385)
I20260810 04:11:29.878424 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.877335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:35045 (local address 127.10.249.129:39187)
0810 04:11:29.877396 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.877399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.877408 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:29.877441 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.877442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.877447 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.877534 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.878218 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.878219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.878220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.878224 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.878242 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.878247 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.878298 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.878353 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.878366 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:11:29.878420 16506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.877250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:39187 (local address 127.10.249.131:35045)
0810 04:11:29.877300 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.877311 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.877347 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.877614 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.877616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.877619 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.878115 (+ 496us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:11:29.878116 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.878122 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:11:29.878134 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.878299 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.878300 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.878301 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.878342 (+ 41us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.878356 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 04:11:29.878726 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.877513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:35047 (local address 127.10.249.130:33385)
0810 04:11:29.877598 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.877600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.877613 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:11:29.877688 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.877689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.877695 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.877757 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.878380 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.878381 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.878382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.878386 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.878401 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.878405 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.878463 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.878662 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.878682 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:11:29.878763 16527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.877366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:33385 (local address 127.10.249.131:35047)
0810 04:11:29.877548 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.877559 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:29.877620 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:29.877767 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:29.877767 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:29.877769 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:29.878273 (+ 504us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:11:29.878274 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:29.878281 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:11:29.878293 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:29.878461 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:29.878462 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:29.878463 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:11:29.878651 (+ 188us) client_negotiation.cc:240] Negotiation successful
0810 04:11:29.878664 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":114,"threads_started":1}
I20260810 04:11:29.878945 16181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "807046ee467c48d39e8ba7f4358da1b0" candidate_uuid: "ea06b1986bd548519088efa03d80c3dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a36b161cdec74eb0ac32989b97329988" is_pre_election: true
I20260810 04:11:29.879103 16181 raft_consensus.cc:2454] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea06b1986bd548519088efa03d80c3dc in term 0.
I20260810 04:11:29.879211 16317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "807046ee467c48d39e8ba7f4358da1b0" candidate_uuid: "ea06b1986bd548519088efa03d80c3dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" is_pre_election: true
I20260810 04:11:29.879344 16388 leader_election.cc:302] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a36b161cdec74eb0ac32989b97329988, ea06b1986bd548519088efa03d80c3dc; no voters:
I20260810 04:11:29.879383 16317 raft_consensus.cc:2454] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea06b1986bd548519088efa03d80c3dc in term 0.
I20260810 04:11:29.879484 16525 raft_consensus.cc:2781] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:29.879534 16525 raft_consensus.cc:482] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:29.879562 16525 raft_consensus.cc:3037] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:29.880312 16525 raft_consensus.cc:504] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.880445 16525 leader_election.cc:288] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [CANDIDATE]: Term 1 election: Requested vote from peers a36b161cdec74eb0ac32989b97329988 (127.10.249.129:39187), fcdfbfed1f6c4062b6105ef63b4f6e1d (127.10.249.130:33385)
I20260810 04:11:29.880599 16181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "807046ee467c48d39e8ba7f4358da1b0" candidate_uuid: "ea06b1986bd548519088efa03d80c3dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a36b161cdec74eb0ac32989b97329988"
I20260810 04:11:29.880610 16317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "807046ee467c48d39e8ba7f4358da1b0" candidate_uuid: "ea06b1986bd548519088efa03d80c3dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d"
I20260810 04:11:29.880689 16317 raft_consensus.cc:3037] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:29.880684 16181 raft_consensus.cc:3037] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:29.881559 16181 raft_consensus.cc:2454] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea06b1986bd548519088efa03d80c3dc in term 1.
I20260810 04:11:29.881559 16317 raft_consensus.cc:2454] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea06b1986bd548519088efa03d80c3dc in term 1.
I20260810 04:11:29.881846 16388 leader_election.cc:302] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a36b161cdec74eb0ac32989b97329988, ea06b1986bd548519088efa03d80c3dc; no voters:
I20260810 04:11:29.881934 16525 raft_consensus.cc:2781] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:29.882054 16525 raft_consensus.cc:686] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 1 LEADER]: Becoming Leader. State: Replica: ea06b1986bd548519088efa03d80c3dc, State: Running, Role: LEADER
I20260810 04:11:29.882121 16525 consensus_queue.cc:237] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } }
I20260810 04:11:29.882949 16032 catalog_manager.cc:5495] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc reported cstate change: term changed from 0 to 1, leader changed from <none> to ea06b1986bd548519088efa03d80c3dc (127.10.249.131). New cstate: current_term: 1 leader_uuid: "ea06b1986bd548519088efa03d80c3dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea06b1986bd548519088efa03d80c3dc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 } health_report { overall_health: UNKNOWN } } }
I20260810 04:11:29.895355 16514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.894463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51690 (local address 127.10.249.131:36969)
0810 04:11:29.894505 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:29.894507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:29.894514 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:11:29.894585 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:29.894586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:29.894596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:29.894636 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:29.895139 (+ 503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:29.895150 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:29.895150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:29.895154 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:29.895168 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:29.895172 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:29.895213 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:29.895274 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 04:11:29.895287 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:11:29.896947 16317 raft_consensus.cc:1261] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d [term 1 FOLLOWER]: Refusing update from remote peer ea06b1986bd548519088efa03d80c3dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:29.896977 16181 raft_consensus.cc:1261] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [term 1 FOLLOWER]: Refusing update from remote peer ea06b1986bd548519088efa03d80c3dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:29.897233 16525 consensus_queue.cc:1035] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcdfbfed1f6c4062b6105ef63b4f6e1d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:29.897367 16528 consensus_queue.cc:1035] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a36b161cdec74eb0ac32989b97329988" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 39187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:29.900801 16532 mvcc.cc:205] Tried to move back new op lower bound from 7316828528215543808 to 7316828528157761536. Current Snapshot: MvccSnapshot[applied={T|T < 7316828528215543808 or (T in {7316828528215543808})}]
I20260810 04:11:29.901569 16033 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:29.901657 16033 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:29.902343 16033 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34c0f71926eb4d8a9ba1ac567b5dff95: Sending DeleteTablet for 3 replicas of tablet 807046ee467c48d39e8ba7f4358da1b0
I20260810 04:11:29.902726 16297 tablet_service.cc:1514] Processing DeleteTablet for tablet 807046ee467c48d39e8ba7f4358da1b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:29 UTC) from {username='slave'} at 127.0.0.1:33536
I20260810 04:11:29.902873 16161 tablet_service.cc:1514] Processing DeleteTablet for tablet 807046ee467c48d39e8ba7f4358da1b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:29 UTC) from {username='slave'} at 127.0.0.1:36356
I20260810 04:11:29.903085 16543 tablet_replica.cc:330] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988: stopping tablet replica
I20260810 04:11:29.903213 16543 raft_consensus.cc:2229] T 807046ee467c48d39e8ba7f4358da1b0 P a36b161cdec74eb0ac32989b97329988 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:29.903249 16433 tablet_service.cc:1514] Processing DeleteTablet for tablet 807046ee467c48d39e8ba7f4358da1b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:29 UTC) from {username='slave'} at 127.0.0.1:51676
I20260810 04:11:29.903270 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 16095
I20260810 04:11:29.909919 16544 tablet_replica.cc:330] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: stopping tablet replica
I20260810 04:11:29.910045 16544 raft_consensus.cc:2229] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 1 LEADER]: Raft consensus shutting down.
W20260810 04:11:29.910108 16020 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:39187 (error 108)
I20260810 04:11:29.910211 16544 raft_consensus.cc:2258] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:29.910279 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 16232
I20260810 04:11:29.909901 16542 tablet_replica.cc:330] T 807046ee467c48d39e8ba7f4358da1b0 P fcdfbfed1f6c4062b6105ef63b4f6e1d: stopping tablet replica
I20260810 04:11:29.911495 16544 ts_tablet_manager.cc:1905] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:29.913019 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.912861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:39187 (local address 127.0.0.1:36364)
0810 04:11:29.912929 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.912980 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:39187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 04:11:29.913143 16020 catalog_manager.cc:4584] TS a36b161cdec74eb0ac32989b97329988 (127.10.249.129:39187): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 807046ee467c48d39e8ba7f4358da1b0: Network error: Client connection negotiation failed: client connection to 127.10.249.129:39187: connect: Connection refused (error 111)
I20260810 04:11:29.913363 16544 ts_tablet_manager.cc:1918] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:29.913437 16544 log.cc:1196] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/807046ee467c48d39e8ba7f4358da1b0
I20260810 04:11:29.913717 16544 ts_tablet_manager.cc:1939] T 807046ee467c48d39e8ba7f4358da1b0 P ea06b1986bd548519088efa03d80c3dc: Deleting consensus metadata
I20260810 04:11:29.914213 16017 catalog_manager.cc:4841] TS ea06b1986bd548519088efa03d80c3dc (127.10.249.131:36969): tablet 807046ee467c48d39e8ba7f4358da1b0 (table test-table [id=7d8196e02f274c1b98eab6cfbaae2251]) successfully deleted
I20260810 04:11:29.916417 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:29.916310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:33385 (local address 127.0.0.1:33544)
0810 04:11:29.916357 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:29.916385 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.130:33385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 04:11:29.916777 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 16369
I20260810 04:11:29.921579 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 16001
2026-08-10T04:11:29Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (705 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 04:11:29.941126 11238 mini_oidc.cc:152] Starting JWKS server
I20260810 04:11:29.942253 11238 webserver.cc:460] Webserver started at https://127.0.0.1:34105/ using document root <none> and password file <none>
I20260810 04:11:29.942359 11238 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 04:11:29.942512 11238 webserver.cc:460] Webserver started at http://127.0.0.1:41933/ using document root <none> and password file <none>
2026-08-10T04:11:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:29Z Disabled control of system clock
I20260810 04:11:29.950812 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:46581
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:40235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:46581
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34105/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/testchainca.cert with env {}
W20260810 04:11:30.032023 16551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:30.032196 16551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:30.032217 16551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:30.033372 16551 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:30.033411 16551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:30.033424 16551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:30.033457 16551 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:30.033485 16551 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 04:11:30.033501 16551 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 04:11:30.033525 16551 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34105/jwks.json
I20260810 04:11:30.035127 16551 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:46581
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:46581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34105/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:30.035370 16551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:30.035570 16551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:30.040222 16557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:30.040249 16556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:30.040249 16559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:30.040431 16551 server_base.cc:1034] running on GCE node
I20260810 04:11:30.040647 16551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:30.040917 16551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:30.042093 16551 hybrid_clock.cc:648] HybridClock initialized: now 1786335090042079 us; error 25 us; skew 500 ppm
I20260810 04:11:30.043202 16551 webserver.cc:460] Webserver started at http://127.10.249.190:36293/ using document root <none> and password file <none>
I20260810 04:11:30.043437 16551 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:30.043501 16551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:30.043643 16551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:30.044631 16551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "a76f86f7a4e54403b218b158c919b07d"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "fe28428161b1d0989fbf03a42b24aaf7"
server_key_iv: "b6c9eb9ecb393f0e3a125fa7794ad3a3"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.044977 16551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "a76f86f7a4e54403b218b158c919b07d"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "fe28428161b1d0989fbf03a42b24aaf7"
server_key_iv: "b6c9eb9ecb393f0e3a125fa7794ad3a3"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.046255 16551 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:30.046944 16565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:30.047088 16551 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:30.047173 16551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "a76f86f7a4e54403b218b158c919b07d"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "fe28428161b1d0989fbf03a42b24aaf7"
server_key_iv: "b6c9eb9ecb393f0e3a125fa7794ad3a3"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.047240 16551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:30.061329 16551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:30.061576 16551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:30.061705 16551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:30.065675 16551 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:46581
I20260810 04:11:30.065718 16623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:46581 every 8 connection(s)
I20260810 04:11:30.066041 16551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:30.066900 16624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:30.068850 16624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d: Bootstrap starting.
I20260810 04:11:30.069511 16624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:30.069875 16624 log.cc:824] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:30.070669 16624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d: No bootstrap required, opened a new log
I20260810 04:11:30.072376 16624 raft_consensus.cc:348] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a76f86f7a4e54403b218b158c919b07d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46581 } }
I20260810 04:11:30.072513 16624 raft_consensus.cc:374] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:30.072556 16624 raft_consensus.cc:729] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a76f86f7a4e54403b218b158c919b07d, State: Initialized, Role: FOLLOWER
I20260810 04:11:30.072697 16624 consensus_queue.cc:260] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a76f86f7a4e54403b218b158c919b07d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46581 } }
I20260810 04:11:30.072772 16624 raft_consensus.cc:388] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:30.072814 16624 raft_consensus.cc:482] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:30.072860 16624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:30.073342 16624 raft_consensus.cc:504] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a76f86f7a4e54403b218b158c919b07d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46581 } }
I20260810 04:11:30.073455 16624 leader_election.cc:302] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a76f86f7a4e54403b218b158c919b07d; no voters:
I20260810 04:11:30.073626 16624 leader_election.cc:288] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:30.073670 16627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:30.073853 16627 raft_consensus.cc:686] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [term 1 LEADER]: Becoming Leader. State: Replica: a76f86f7a4e54403b218b158c919b07d, State: Running, Role: LEADER
I20260810 04:11:30.073926 16624 sys_catalog.cc:564] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:30.073961 16627 consensus_queue.cc:237] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a76f86f7a4e54403b218b158c919b07d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46581 } }
I20260810 04:11:30.074354 16629 sys_catalog.cc:455] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a76f86f7a4e54403b218b158c919b07d. Latest consensus state: current_term: 1 leader_uuid: "a76f86f7a4e54403b218b158c919b07d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a76f86f7a4e54403b218b158c919b07d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46581 } } }
I20260810 04:11:30.074437 16629 sys_catalog.cc:458] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:30.074707 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 16551
I20260810 04:11:30.074805 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:30.074855 16635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:30.074990 11238 external_mini_cluster.cc:1428] Setting key d40268ab4b9bfab2b595298e010e80dd
I20260810 04:11:30.075347 16635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:30.075505 16628 sys_catalog.cc:455] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a76f86f7a4e54403b218b158c919b07d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a76f86f7a4e54403b218b158c919b07d" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46581 } } }
I20260810 04:11:30.075696 16628 sys_catalog.cc:458] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:30.080343 16646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:30.075384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49742 (local address 127.10.249.190:46581)
0810 04:11:30.075843 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:30.075853 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:30.075994 (+ 141us) server_negotiation.cc:407] Connection header received
0810 04:11:30.076168 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:30.076176 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:30.076248 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:30.076384 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:30.076567 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.077434 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.078608 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.078978 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.079054 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.079664 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:30.079667 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:30.079668 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:30.079874 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:30.079905 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:30.079915 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:30.079965 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:30.080065 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 04:11:30.080154 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":73,"threads_started":1}
I20260810 04:11:30.081187 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:11:30.086164 16635 catalog_manager.cc:1347] Generated new cluster ID: 51571cb98a064ddaab4a4cb474bc8e8d
I20260810 04:11:30.086205 16635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:11:30.103122 16635 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:30.103578 16635 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:30.110359 16635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a76f86f7a4e54403b218b158c919b07d: Generated new TSK 0
I20260810 04:11:30.110495 16635 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 04:11:30.140982 16655 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 04:11:30.141155 16655 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 04:11:30.141360 16646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:30.127115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49748 (local address 127.10.249.190:46581)
0810 04:11:30.127194 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:30.127196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:30.127302 (+ 106us) server_negotiation.cc:407] Connection header received
0810 04:11:30.127385 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:30.127386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:30.127395 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:30.127445 (+ 50us) server_negotiation.cc:226] Negotiated authn=JWT
0810 04:11:30.127614 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.128038 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.129160 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.129329 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.129372 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.129591 (+ 219us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 04:11:30.141168 (+ 11577us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34105/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 04:11:30.141318 (+ 150us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49748: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34105/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 04:11:30.141429 16646 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49748: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34105/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 04:11:30.141937 16654 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:11:30.127058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46581 (local address 127.0.0.1:49748)
0810 04:11:30.127236 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:30.127246 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:30.127309 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:30.127469 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:30.127470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:30.127472 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 04:11:30.127553 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:30.127555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.128127 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.128128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:30.129049 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:30.129052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.129400 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.129401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:30.129460 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.129481 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 04:11:30.141322 (+ 11841us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34105/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 04:11:30.141454 (+ 132us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.249.190:46581: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34105/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":97,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.249.190:46581: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34105/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 04:11:30.142340 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 16551
2026-08-10T04:11:30Z chronyd exiting
I20260810 04:11:30.179823 11238 test_util.cc:175] -----------------------------------------------
I20260810 04:11:30.179895 11238 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786335069075394-11238-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (239 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 04:11:30.180696 11238 mini_oidc.cc:152] Starting JWKS server
I20260810 04:11:30.181349 11238 webserver.cc:460] Webserver started at https://127.0.0.1:37309/ using document root <none> and password file <none>
I20260810 04:11:30.181383 11238 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 04:11:30.181535 11238 webserver.cc:460] Webserver started at http://127.0.0.1:42849/ using document root <none> and password file <none>
2026-08-10T04:11:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:30Z Disabled control of system clock
I20260810 04:11:30.189700 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:33117
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:39813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:33117
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37309/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/testchainca.cert with env {}
W20260810 04:11:30.264041 16661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:30.264257 16661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:30.264297 16661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:30.265354 16661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:30.265408 16661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:30.265425 16661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:30.265443 16661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:30.265470 16661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 04:11:30.265488 16661 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 04:11:30.265509 16661 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37309/jwks.json
I20260810 04:11:30.266942 16661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:39813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:33117
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:33117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37309/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:30.267192 16661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:30.267398 16661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:30.271986 16667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:30.271996 16672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:30.272008 16666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:30.272022 16661 server_base.cc:1034] running on GCE node
I20260810 04:11:30.272425 16661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:30.272670 16661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:30.273833 16661 hybrid_clock.cc:648] HybridClock initialized: now 1786335090273812 us; error 36 us; skew 500 ppm
I20260810 04:11:30.274963 16661 webserver.cc:460] Webserver started at http://127.10.249.190:37763/ using document root <none> and password file <none>
I20260810 04:11:30.275194 16661 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:30.275256 16661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:30.275373 16661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:30.276259 16661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "241feff0e7e940a8b7e56855e903926f"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "7a703a00863be6efb768b5d35129565f"
server_key_iv: "a8770d1b5b8d6d3c8a64070233881f90"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.276582 16661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "241feff0e7e940a8b7e56855e903926f"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "7a703a00863be6efb768b5d35129565f"
server_key_iv: "a8770d1b5b8d6d3c8a64070233881f90"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.277848 16661 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:30.278584 16678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:30.278744 16661 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:30.278836 16661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "241feff0e7e940a8b7e56855e903926f"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "7a703a00863be6efb768b5d35129565f"
server_key_iv: "a8770d1b5b8d6d3c8a64070233881f90"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.278913 16661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:30.298111 16661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:30.298363 16661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:30.298492 16661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:30.301977 16661 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:33117
I20260810 04:11:30.302008 16732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:33117 every 8 connection(s)
I20260810 04:11:30.302285 16661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:30.302911 16733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:30.303709 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 16661
I20260810 04:11:30.303841 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:30.304049 11238 external_mini_cluster.cc:1428] Setting key 505a102aac11ccc59d429ff97b037c75
I20260810 04:11:30.306046 16733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f: Bootstrap starting.
I20260810 04:11:30.306663 16733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:30.306941 16733 log.cc:824] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:30.307646 16733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f: No bootstrap required, opened a new log
I20260810 04:11:30.309250 16736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:30.304534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47616 (local address 127.10.249.190:33117)
0810 04:11:30.304771 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:30.304778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:30.304800 (+ 22us) server_negotiation.cc:407] Connection header received
0810 04:11:30.305197 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:30.305203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:30.305277 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:30.305412 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:30.305623 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.306586 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.307448 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.307904 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.308040 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.308666 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:30.308670 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:30.308670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:30.308817 (+ 147us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:30.308848 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:30.308857 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:30.308918 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:30.308993 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 04:11:30.309064 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":75,"threads_started":1}
I20260810 04:11:30.309432 16733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241feff0e7e940a8b7e56855e903926f" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 33117 } }
I20260810 04:11:30.309593 16733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:30.309633 16733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 241feff0e7e940a8b7e56855e903926f, State: Initialized, Role: FOLLOWER
I20260810 04:11:30.309741 16733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241feff0e7e940a8b7e56855e903926f" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 33117 } }
I20260810 04:11:30.309887 16733 raft_consensus.cc:388] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:30.309933 16733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:30.309985 16733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:30.310112 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:11:30.310575 16733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241feff0e7e940a8b7e56855e903926f" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 33117 } }
I20260810 04:11:30.310693 16733 leader_election.cc:302] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 241feff0e7e940a8b7e56855e903926f; no voters:
I20260810 04:11:30.310846 16733 leader_election.cc:288] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:30.310874 16739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:30.310961 16739 raft_consensus.cc:686] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [term 1 LEADER]: Becoming Leader. State: Replica: 241feff0e7e940a8b7e56855e903926f, State: Running, Role: LEADER
I20260810 04:11:30.311028 16739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241feff0e7e940a8b7e56855e903926f" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 33117 } }
I20260810 04:11:30.311066 16733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:30.311314 16739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "241feff0e7e940a8b7e56855e903926f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241feff0e7e940a8b7e56855e903926f" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 33117 } } }
I20260810 04:11:30.311380 16739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:30.311491 16739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 241feff0e7e940a8b7e56855e903926f. Latest consensus state: current_term: 1 leader_uuid: "241feff0e7e940a8b7e56855e903926f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241feff0e7e940a8b7e56855e903926f" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 33117 } } }
I20260810 04:11:30.311554 16739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:30.311611 16743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:30.312095 16743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:30.313560 16743 catalog_manager.cc:1347] Generated new cluster ID: 96331f733d024c32bccf54494cccac85
I20260810 04:11:30.313603 16743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:11:30.330405 16743 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:30.331035 16743 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:30.338176 16743 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 241feff0e7e940a8b7e56855e903926f: Generated new TSK 0
I20260810 04:11:30.338354 16743 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 04:11:30.366951 16765 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 04:11:30.367038 16765 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 04:11:30.367367 16736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:30.346242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47620 (local address 127.10.249.190:33117)
0810 04:11:30.346303 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:30.346305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:30.346426 (+ 121us) server_negotiation.cc:407] Connection header received
0810 04:11:30.346493 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:30.346494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:30.346504 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:30.346556 (+ 52us) server_negotiation.cc:226] Negotiated authn=JWT
0810 04:11:30.346659 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.347125 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.348146 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.348315 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.348359 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.348523 (+ 164us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 04:11:30.367184 (+ 18661us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37309/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 04:11:30.367305 (+ 121us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47620: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37309/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 04:11:30.367434 16736 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47620: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37309/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 04:11:30.367532 16764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:11:30.346202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:33117 (local address 127.0.0.1:47620)
0810 04:11:30.346360 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:30.346371 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:30.346433 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:30.346558 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:30.346559 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:30.346561 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 04:11:30.346613 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:30.346615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.347213 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.347214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:30.348075 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:30.348078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.348378 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.348379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:30.348435 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.348440 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 04:11:30.367287 (+ 18847us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37309/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 04:11:30.367428 (+ 141us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.249.190:33117: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37309/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":111,"threads_started":1}
I20260810 04:11:30.367821 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 16661
2026-08-10T04:11:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (226 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 04:11:30.407426 11238 mini_oidc.cc:152] Starting JWKS server
I20260810 04:11:30.408067 11238 webserver.cc:460] Webserver started at https://127.0.0.1:34669/ using document root <none> and password file <none>
I20260810 04:11:30.408107 11238 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 04:11:30.408274 11238 webserver.cc:460] Webserver started at http://127.0.0.1:42807/ using document root <none> and password file <none>
2026-08-10T04:11:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:30Z Disabled control of system clock
I20260810 04:11:30.416231 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42131
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:37869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:42131
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34669/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 04:11:30.494007 16774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:30.494194 16774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:30.494212 16774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:30.495378 16774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:30.495414 16774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:30.495428 16774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:30.495441 16774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:30.495453 16774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 04:11:30.495474 16774 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 04:11:30.495491 16774 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34669/jwks.json
I20260810 04:11:30.496693 16774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:37869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:42131
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34669/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:30.496891 16774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:30.497092 16774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:30.501557 16779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:30.501592 16780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:30.501575 16784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:30.501763 16774 server_base.cc:1034] running on GCE node
I20260810 04:11:30.501995 16774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:30.502240 16774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:30.503371 16774 hybrid_clock.cc:648] HybridClock initialized: now 1786335090503362 us; error 26 us; skew 500 ppm
I20260810 04:11:30.504470 16774 webserver.cc:460] Webserver started at http://127.10.249.190:38953/ using document root <none> and password file <none>
I20260810 04:11:30.504678 16774 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:30.504719 16774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:30.504868 16774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:30.505900 16774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "524e06ed8fe645f7ad76b41459cba769"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "033b6cf6707a250b166650a880b1c104"
server_key_iv: "e5c9875bee1b3c3f8bbe4e95a31fab26"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.506242 16774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "524e06ed8fe645f7ad76b41459cba769"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "033b6cf6707a250b166650a880b1c104"
server_key_iv: "e5c9875bee1b3c3f8bbe4e95a31fab26"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.507440 16774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:30.508157 16790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:30.508318 16774 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:30.508409 16774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "524e06ed8fe645f7ad76b41459cba769"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "033b6cf6707a250b166650a880b1c104"
server_key_iv: "e5c9875bee1b3c3f8bbe4e95a31fab26"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.508479 16774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:30.526415 16774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:30.526660 16774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:30.526794 16774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:30.530599 16774 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:42131
I20260810 04:11:30.530629 16842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:42131 every 8 connection(s)
I20260810 04:11:30.530925 16774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:30.531483 16843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:30.534001 16843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769: Bootstrap starting.
I20260810 04:11:30.534512 16843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:30.534746 16843 log.cc:824] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:30.535315 16843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769: No bootstrap required, opened a new log
I20260810 04:11:30.536659 16843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524e06ed8fe645f7ad76b41459cba769" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42131 } }
I20260810 04:11:30.536774 16843 raft_consensus.cc:374] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:30.536794 16843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 524e06ed8fe645f7ad76b41459cba769, State: Initialized, Role: FOLLOWER
I20260810 04:11:30.536908 16843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524e06ed8fe645f7ad76b41459cba769" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42131 } }
I20260810 04:11:30.536983 16843 raft_consensus.cc:388] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:30.537004 16843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:30.537035 16843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:30.537494 16843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524e06ed8fe645f7ad76b41459cba769" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42131 } }
I20260810 04:11:30.537570 16843 leader_election.cc:302] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 524e06ed8fe645f7ad76b41459cba769; no voters:
I20260810 04:11:30.537683 16843 leader_election.cc:288] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:30.537748 16846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:30.537890 16846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [term 1 LEADER]: Becoming Leader. State: Replica: 524e06ed8fe645f7ad76b41459cba769, State: Running, Role: LEADER
I20260810 04:11:30.537927 16843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:30.537982 16846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524e06ed8fe645f7ad76b41459cba769" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42131 } }
I20260810 04:11:30.538352 16847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "524e06ed8fe645f7ad76b41459cba769" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524e06ed8fe645f7ad76b41459cba769" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42131 } } }
I20260810 04:11:30.538506 16847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:30.538547 16848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 524e06ed8fe645f7ad76b41459cba769. Latest consensus state: current_term: 1 leader_uuid: "524e06ed8fe645f7ad76b41459cba769" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "524e06ed8fe645f7ad76b41459cba769" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42131 } } }
I20260810 04:11:30.538633 16848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:30.538897 16856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:30.539355 16856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:30.540676 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 16774
I20260810 04:11:30.540794 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:30.540856 16856 catalog_manager.cc:1347] Generated new cluster ID: 4ab53d783ff247cfb1934251a63d4aed
I20260810 04:11:30.540910 16856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:11:30.540988 11238 external_mini_cluster.cc:1428] Setting key 291146dc5a500f213c4c7a82aa9beb2e
I20260810 04:11:30.545830 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:30.541403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59674 (local address 127.10.249.190:42131)
0810 04:11:30.541586 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:30.541592 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:30.541983 (+ 391us) server_negotiation.cc:407] Connection header received
0810 04:11:30.542121 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:30.542127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:30.542178 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:30.542298 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:30.542497 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.543372 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.544133 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.544519 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.544636 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.545228 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:30.545232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:30.545232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:30.545384 (+ 152us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:30.545412 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:30.545421 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:30.545487 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:30.545554 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 04:11:30.545628 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":65,"threads_started":1}
I20260810 04:11:30.546721 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:11:30.550194 16856 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:30.550621 16856 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:30.553838 16856 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 524e06ed8fe645f7ad76b41459cba769: Generated new TSK 0
I20260810 04:11:30.553987 16856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:11:30.562183 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:30.558043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59676 (local address 127.10.249.190:42131)
0810 04:11:30.558078 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:30.558080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:30.558157 (+ 77us) server_negotiation.cc:407] Connection header received
0810 04:11:30.558235 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:30.558236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:30.558245 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:30.558297 (+ 52us) server_negotiation.cc:226] Negotiated authn=JWT
0810 04:11:30.558426 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.558894 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.560024 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.560229 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.560276 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.560453 (+ 177us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 04:11:30.561987 (+ 1534us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 04:11:30.562113 (+ 126us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59676: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 04:11:30.562238 16867 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59676: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 04:11:30.562379 16873 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:11:30.557976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:42131 (local address 127.0.0.1:59676)
0810 04:11:30.558108 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:30.558117 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:30.558171 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:30.558309 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:30.558310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:30.558311 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0810 04:11:30.558375 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:30.558376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.558981 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.558983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:30.559934 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:30.559937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.560299 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.560300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:30.560364 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.560369 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 04:11:30.562080 (+ 1711us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 04:11:30.562177 (+ 97us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.249.190:42131: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
I20260810 04:11:30.562796 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 16774
E20260810 04:11:30.575219 16874 webserver.cc:533] Webserver: sslize failed:
E20260810 04:11:30.575281 16874 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T04:11:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (196 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T04:11:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:30Z Disabled control of system clock
I20260810 04:11:30.612205 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:40965
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:43257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:40965
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/testchainca.cert with env {}
W20260810 04:11:30.692301 16879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:30.692531 16879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:30.692553 16879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:30.693826 16879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:30.693867 16879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:30.693881 16879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:30.693892 16879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:30.693948 16879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 04:11:30.693965 16879 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 04:11:30.694000 16879 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 04:11:30.695451 16879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:40965
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:40965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:30.695732 16879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:30.695955 16879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:30.700822 16887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:30.700829 16884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:30.700827 16885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:30.701084 16879 server_base.cc:1034] running on GCE node
I20260810 04:11:30.701278 16879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:30.701565 16879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:30.702715 16879 hybrid_clock.cc:648] HybridClock initialized: now 1786335090702687 us; error 48 us; skew 500 ppm
I20260810 04:11:30.703982 16879 webserver.cc:460] Webserver started at http://127.10.249.190:43875/ using document root <none> and password file <none>
I20260810 04:11:30.704221 16879 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:30.704267 16879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:30.704411 16879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:30.705391 16879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "e896e0214c304d1da1001871c24ac0cc"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "d0696844300473713f7803133626b844"
server_key_iv: "44202ac62de3837ce487b79fbe47f88d"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.705699 16879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "e896e0214c304d1da1001871c24ac0cc"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "d0696844300473713f7803133626b844"
server_key_iv: "44202ac62de3837ce487b79fbe47f88d"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.707000 16879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:11:30.707690 16893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:30.707863 16879 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:30.707937 16879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "e896e0214c304d1da1001871c24ac0cc"
format_stamp: "Formatted at 2026-08-10 04:11:30 on dist-test-slave-0kls"
server_key: "d0696844300473713f7803133626b844"
server_key_iv: "44202ac62de3837ce487b79fbe47f88d"
server_key_version: "encryptionkey@0"
I20260810 04:11:30.707991 16879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:30.717458 16879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:30.717695 16879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:30.717856 16879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:30.721719 16879 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:40965
I20260810 04:11:30.721750 16952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:40965 every 8 connection(s)
I20260810 04:11:30.722100 16879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:30.723052 16953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:30.725174 16953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc: Bootstrap starting.
I20260810 04:11:30.725684 16953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:30.726009 16953 log.cc:824] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:30.726593 16953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc: No bootstrap required, opened a new log
I20260810 04:11:30.726871 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 16879
I20260810 04:11:30.726966 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:30.727172 11238 external_mini_cluster.cc:1428] Setting key fa43426e1a2e595b155229391c0c926e
I20260810 04:11:30.728511 16953 raft_consensus.cc:348] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e896e0214c304d1da1001871c24ac0cc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40965 } }
I20260810 04:11:30.728657 16953 raft_consensus.cc:374] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:30.728701 16953 raft_consensus.cc:729] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e896e0214c304d1da1001871c24ac0cc, State: Initialized, Role: FOLLOWER
I20260810 04:11:30.728832 16953 consensus_queue.cc:260] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e896e0214c304d1da1001871c24ac0cc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40965 } }
I20260810 04:11:30.728914 16953 raft_consensus.cc:388] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:30.728951 16953 raft_consensus.cc:482] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:30.728989 16953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:30.729452 16953 raft_consensus.cc:504] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e896e0214c304d1da1001871c24ac0cc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40965 } }
I20260810 04:11:30.729529 16953 leader_election.cc:302] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e896e0214c304d1da1001871c24ac0cc; no voters:
I20260810 04:11:30.729717 16953 leader_election.cc:288] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:30.729748 16958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:30.729897 16958 raft_consensus.cc:686] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [term 1 LEADER]: Becoming Leader. State: Replica: e896e0214c304d1da1001871c24ac0cc, State: Running, Role: LEADER
I20260810 04:11:30.729975 16953 sys_catalog.cc:564] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:30.729975 16958 consensus_queue.cc:237] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e896e0214c304d1da1001871c24ac0cc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40965 } }
I20260810 04:11:30.730350 16958 sys_catalog.cc:455] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader e896e0214c304d1da1001871c24ac0cc. Latest consensus state: current_term: 1 leader_uuid: "e896e0214c304d1da1001871c24ac0cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e896e0214c304d1da1001871c24ac0cc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40965 } } }
I20260810 04:11:30.730368 16960 sys_catalog.cc:455] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e896e0214c304d1da1001871c24ac0cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e896e0214c304d1da1001871c24ac0cc" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40965 } } }
I20260810 04:11:30.730432 16958 sys_catalog.cc:458] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:30.730456 16960 sys_catalog.cc:458] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc [sys.catalog]: This master's current role is: LEADER
W20260810 04:11:30.731714 16974 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:11:30.731765 16974 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:11:30.731812 16964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:30.731936 16964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:30.733409 16964 catalog_manager.cc:1347] Generated new cluster ID: aa34c67182a7445ba7020e6183a2aa77
I20260810 04:11:30.733484 16964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:11:30.733588 16957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:30.727632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60706 (local address 127.10.249.190:40965)
0810 04:11:30.727807 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:30.727814 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:30.727836 (+ 22us) server_negotiation.cc:407] Connection header received
0810 04:11:30.728504 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:30.728512 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:30.728570 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:30.728744 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:30.728948 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.730422 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.731515 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.731954 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.732075 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.732646 (+ 571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:30.732650 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:30.732650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:11:30.732916 (+ 266us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:30.732960 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:11:30.732974 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:30.733063 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:30.733130 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 04:11:30.733294 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
I20260810 04:11:30.738379 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:11:30.750017 16964 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:30.750483 16964 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:30.754396 16964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e896e0214c304d1da1001871c24ac0cc: Generated new TSK 0
I20260810 04:11:30.754561 16964 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:11:30.831585 16957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:30.766400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60716 (local address 127.10.249.190:40965)
0810 04:11:30.766439 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:30.766442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:30.766512 (+ 70us) server_negotiation.cc:407] Connection header received
0810 04:11:30.766581 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:30.766582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:30.766592 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:30.766651 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0810 04:11:30.766795 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.767242 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.768261 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.768440 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.768494 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.768666 (+ 172us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 04:11:30.831290 (+ 62624us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 04:11:30.831481 (+ 191us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60716: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:11:30.831660 16957 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60716: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 04:11:30.831709 16982 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:11:30.766292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:40965 (local address 127.0.0.1:60716)
0810 04:11:30.766436 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:30.766448 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:30.766513 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:30.766660 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:30.766661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:30.766663 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 04:11:30.766732 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:30.766735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.767309 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.767310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:30.768180 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:30.768183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:30.768518 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:30.768519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:30.768578 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:30.768583 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 04:11:30.831457 (+ 62874us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 04:11:30.831605 (+ 148us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.249.190:40965: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
I20260810 04:11:30.832006 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 16879
2026-08-10T04:11:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (246 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (82 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (85 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:31 dist-test-slave-0kls krb5kdc[16994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:31 dist-test-slave-0kls krb5kdc[16994](info): set up 2 sockets
Aug 10 04:11:31 dist-test-slave-0kls krb5kdc[16994](info): commencing operation
krb5kdc: starting...
W20260810 04:11:32.003156 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.985s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:11:32.120359 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:36267
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:36267
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:32.200119 17007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:32.200314 17007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:32.200335 17007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:32.201378 17007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:32.201409 17007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:32.201422 17007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:32.201433 17007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:32.201444 17007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:32.202847 17007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:36267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:36267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:32.203047 17007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:32.203203 17007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:32.207785 17015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:32.207789 17017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:32.207815 17007 server_base.cc:1034] running on GCE node
W20260810 04:11:32.207937 17014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:32.208204 17007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:32.208444 17007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:32.209587 17007 hybrid_clock.cc:648] HybridClock initialized: now 1786335092209575 us; error 28 us; skew 500 ppm
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.215445 17007 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:11:32.215945 17007 webserver.cc:460] Webserver started at http://127.10.249.190:45521/ using document root <none> and password file <none>
I20260810 04:11:32.216157 17007 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:32.216200 17007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:32.216359 17007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:32.217761 17007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "e524a36e1eb2468bb9311c5529c74862"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "8cf3b3cd5af223e5d6fa718c1b8cbf40"
server_key_iv: "5da3ece4583d9e83b8c381849924abbf"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.218173 17007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "e524a36e1eb2468bb9311c5529c74862"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "8cf3b3cd5af223e5d6fa718c1b8cbf40"
server_key_iv: "5da3ece4583d9e83b8c381849924abbf"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.219491 17007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:32.220219 17027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.220396 17007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:32.220491 17007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "e524a36e1eb2468bb9311c5529c74862"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "8cf3b3cd5af223e5d6fa718c1b8cbf40"
server_key_iv: "5da3ece4583d9e83b8c381849924abbf"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.220561 17007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:32.240031 17007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:32.241711 17007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:32.241899 17007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:32.245985 17007 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:36267
I20260810 04:11:32.246050 17082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:36267 every 8 connection(s)
I20260810 04:11:32.246385 17007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:32.247231 17083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:32.249528 17083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862: Bootstrap starting.
I20260810 04:11:32.250178 17083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:32.250473 17083 log.cc:824] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:32.251148 17083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862: No bootstrap required, opened a new log
I20260810 04:11:32.252655 17083 raft_consensus.cc:348] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e524a36e1eb2468bb9311c5529c74862" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36267 } }
I20260810 04:11:32.252801 17083 raft_consensus.cc:374] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:32.252862 17083 raft_consensus.cc:729] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e524a36e1eb2468bb9311c5529c74862, State: Initialized, Role: FOLLOWER
I20260810 04:11:32.253034 17083 consensus_queue.cc:260] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e524a36e1eb2468bb9311c5529c74862" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36267 } }
I20260810 04:11:32.253100 17083 raft_consensus.cc:388] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:32.253136 17083 raft_consensus.cc:482] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:32.253189 17083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:32.253715 17083 raft_consensus.cc:504] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e524a36e1eb2468bb9311c5529c74862" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36267 } }
I20260810 04:11:32.253855 17083 leader_election.cc:302] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e524a36e1eb2468bb9311c5529c74862; no voters:
I20260810 04:11:32.254041 17083 leader_election.cc:288] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:32.254084 17086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:32.254302 17083 sys_catalog.cc:564] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:32.254518 17086 raft_consensus.cc:686] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [term 1 LEADER]: Becoming Leader. State: Replica: e524a36e1eb2468bb9311c5529c74862, State: Running, Role: LEADER
I20260810 04:11:32.254609 17086 consensus_queue.cc:237] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e524a36e1eb2468bb9311c5529c74862" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36267 } }
I20260810 04:11:32.255015 17087 sys_catalog.cc:455] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e524a36e1eb2468bb9311c5529c74862" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e524a36e1eb2468bb9311c5529c74862" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36267 } } }
I20260810 04:11:32.255125 17087 sys_catalog.cc:458] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:32.255012 17088 sys_catalog.cc:455] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e524a36e1eb2468bb9311c5529c74862. Latest consensus state: current_term: 1 leader_uuid: "e524a36e1eb2468bb9311c5529c74862" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e524a36e1eb2468bb9311c5529c74862" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36267 } } }
I20260810 04:11:32.255229 17088 sys_catalog.cc:458] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:32.255362 17095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:32.255780 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 17007
I20260810 04:11:32.255887 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:32.256057 11238 external_mini_cluster.cc:1428] Setting key a6d999e770d809cffcd05ba631a6956a
I20260810 04:11:32.256325 17095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:32.257943 17095 catalog_manager.cc:1347] Generated new cluster ID: 1b9df68164f94fd0b0b42a23c560e1f9
I20260810 04:11:32.258000 17095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:32.266443 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.256763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52316 (local address 127.10.249.190:36267)
0810 04:11:32.256919 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.256927 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.256972 (+ 45us) server_negotiation.cc:407] Connection header received
0810 04:11:32.257099 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.257106 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.257165 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.257299 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.258079 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.258974 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.259732 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.260152 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.260269 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.262716 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:32.262720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:32.262721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:32.262733 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:32.264816 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.265192 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.265195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.265196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.265312 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.265491 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.265492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.265492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.265842 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:32.265998 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:32.266072 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 04:11:32.266224 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":81,"threads_started":1}
I20260810 04:11:32.275511 17095 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:32.276077 17095 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:32.284531 17095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e524a36e1eb2468bb9311c5529c74862: Generated new TSK 0
I20260810 04:11:32.284734 17095 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:11:32.314112 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36267
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:32.394171 17110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:32.394356 17110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:32.394378 17110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:32.395488 17110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:32.395525 17110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:32.395548 17110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:32.396890 17110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:32.397116 17110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:32.397307 17110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:32.402132 17118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:32.402177 17115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:32.402144 17116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:32.402186 17110 server_base.cc:1034] running on GCE node
I20260810 04:11:32.402524 17110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:32.402726 17110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:32.403882 17110 hybrid_clock.cc:648] HybridClock initialized: now 1786335092403886 us; error 45 us; skew 500 ppm
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.406344 17110 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:11:32.406719 17110 webserver.cc:460] Webserver started at http://127.10.249.129:43031/ using document root <none> and password file <none>
I20260810 04:11:32.406937 17110 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:32.406999 17110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:32.407130 17110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:32.408062 17110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "c74713391ec54f47af6e852c8108fb9d"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "f85f5e517c3b4bfa3ff07bc977e654be"
server_key_iv: "8187cb91972abbc4182b6ca3e8552dd4"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.408398 17110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "c74713391ec54f47af6e852c8108fb9d"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "f85f5e517c3b4bfa3ff07bc977e654be"
server_key_iv: "8187cb91972abbc4182b6ca3e8552dd4"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.409588 17110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:11:32.410307 17125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.410462 17110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.410553 17110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "c74713391ec54f47af6e852c8108fb9d"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "f85f5e517c3b4bfa3ff07bc977e654be"
server_key_iv: "8187cb91972abbc4182b6ca3e8552dd4"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.410626 17110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:32.421749 17110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:32.423951 17110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:32.424116 17110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:32.424335 17110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:32.424612 17110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:32.424645 17110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.424667 17110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:32.424710 17110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.430500 17110 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:42187
I20260810 04:11:32.430536 17245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:42187 every 8 connection(s)
I20260810 04:11:32.430840 17110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:32.439128 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.431544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:60975 (local address 127.10.249.190:36267)
0810 04:11:32.431619 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.431621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.431768 (+ 147us) server_negotiation.cc:407] Connection header received
0810 04:11:32.432581 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.432581 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.432596 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.432634 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.433174 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.433660 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.434668 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.434864 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.434917 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.436818 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:32.436819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:32.436820 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:32.436826 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:32.438175 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.438480 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.438481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.438481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.438526 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.438705 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.438705 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.438705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.438794 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:32.438838 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:32.439016 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 04:11:32.439073 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:11:32.439188 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 17110
I20260810 04:11:32.439280 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:32.439452 17248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.431512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:36267 (local address 127.10.249.129:60975)
0810 04:11:32.431666 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:32.431698 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:32.432490 (+ 792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:32.432685 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:32.432688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:32.432926 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:32.433101 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:32.433105 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.433734 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.433735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:32.434601 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:32.434604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.434932 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.434933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:32.435027 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.435422 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:32.435430 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:32.436732 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:32.438239 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:32.438245 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:32.438246 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:32.438428 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:32.438574 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:32.438575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:32.438575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:32.438660 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:32.438840 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:32.438844 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:32.438937 (+ 93us) client_negotiation.cc:769] Sending connection context
0810 04:11:32.439006 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 04:11:32.439176 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260810 04:11:32.439463 11238 external_mini_cluster.cc:1428] Setting key d275747b561161d015da51e35dcc7e94
I20260810 04:11:32.439982 17246 heartbeater.cc:347] Connected to a master server at 127.10.249.190:36267
I20260810 04:11:32.440071 17246 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:32.440243 17246 heartbeater.cc:511] Master 127.10.249.190:36267 requested a full tablet report, sending...
I20260810 04:11:32.440765 17044 ts_manager.cc:194] Registered new tserver with Master: c74713391ec54f47af6e852c8108fb9d (127.10.249.129:42187)
I20260810 04:11:32.441402 17044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:60975
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:11:32.462800 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36267
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:32.541296 17251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:32.541500 17251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:32.541536 17251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:32.542698 17251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:32.542764 17251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:32.542811 17251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:32.544309 17251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:32.544610 17251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:32.544832 17251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:32.549638 17259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:32.549700 17256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:32.549625 17257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:32.549814 17251 server_base.cc:1034] running on GCE node
I20260810 04:11:32.549993 17251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:32.550218 17251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:32.551359 17251 hybrid_clock.cc:648] HybridClock initialized: now 1786335092551349 us; error 24 us; skew 500 ppm
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.553635 17251 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:11:32.554181 17251 webserver.cc:460] Webserver started at http://127.10.249.130:36029/ using document root <none> and password file <none>
I20260810 04:11:32.554507 17251 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:32.554572 17251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:32.554710 17251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:32.555837 17251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "e2ef5c314e7d43778c4298a1913a24b1"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "122845c51d1b4712233ebaced7e77b2c"
server_key_iv: "6765fd111984fce711de5f0d7aff75e8"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.556196 17251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "e2ef5c314e7d43778c4298a1913a24b1"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "122845c51d1b4712233ebaced7e77b2c"
server_key_iv: "6765fd111984fce711de5f0d7aff75e8"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.557421 17251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:11:32.558151 17266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.558310 17251 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.558400 17251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "e2ef5c314e7d43778c4298a1913a24b1"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "122845c51d1b4712233ebaced7e77b2c"
server_key_iv: "6765fd111984fce711de5f0d7aff75e8"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.558473 17251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:32.567029 17251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:32.568866 17251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:32.569017 17251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:32.569231 17251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:32.569530 17251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:32.569581 17251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.569626 17251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:32.569662 17251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.575421 17251 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:38871
I20260810 04:11:32.575467 17384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:38871 every 8 connection(s)
I20260810 04:11:32.575763 17251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:11:32.577417 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 17251
I20260810 04:11:32.577538 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:32.577742 11238 external_mini_cluster.cc:1428] Setting key 38026fef37316d38091490e4fdcd5106
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:32.585381 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.576491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:34667 (local address 127.10.249.190:36267)
0810 04:11:32.576556 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.576558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.576765 (+ 207us) server_negotiation.cc:407] Connection header received
0810 04:11:32.577746 (+ 981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.577748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.577762 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.577857 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.578458 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.578939 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.579946 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.580136 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.580208 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.582629 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:32.582630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:32.582630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:32.582636 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:32.583968 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.584458 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.584459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.584460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.584506 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.584775 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.584775 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.584776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.584867 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:32.584912 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:32.585255 (+ 343us) server_negotiation.cc:299] Negotiation successful
0810 04:11:32.585317 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:11:32.585685 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.576471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:36267 (local address 127.10.249.130:34667)
0810 04:11:32.576631 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:32.576680 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:32.577638 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:32.577933 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:32.577942 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:32.578184 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:32.578365 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:32.578370 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.579028 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.579030 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:32.579846 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:32.579849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.580214 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.580216 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:32.580348 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.580863 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:32.580871 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:32.582542 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:32.584075 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:32.584082 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:32.584084 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:32.584389 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:32.584563 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:32.584564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:32.584564 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:32.584714 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:32.584932 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:32.584939 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:32.585101 (+ 162us) client_negotiation.cc:769] Sending connection context
0810 04:11:32.585244 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 04:11:32.585422 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260810 04:11:32.586269 17385 heartbeater.cc:347] Connected to a master server at 127.10.249.190:36267
I20260810 04:11:32.586393 17385 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:32.586598 17385 heartbeater.cc:511] Master 127.10.249.190:36267 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
I20260810 04:11:32.586967 17044 ts_manager.cc:194] Registered new tserver with Master: e2ef5c314e7d43778c4298a1913a24b1 (127.10.249.130:38871)
I20260810 04:11:32.587320 17044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:34667
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:11:32.604243 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36267
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:32.685506 17390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:32.685720 17390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:32.685745 17390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:32.686897 17390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:32.686939 17390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:32.686964 17390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:32.688361 17390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:36267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:32.688566 17390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:32.688761 17390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:32.694178 17395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:32.694155 17396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:32.694155 17398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:32.694509 17390 server_base.cc:1034] running on GCE node
I20260810 04:11:32.694725 17390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:32.694919 17390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:32.696084 17390 hybrid_clock.cc:648] HybridClock initialized: now 1786335092696079 us; error 43 us; skew 500 ppm
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.698614 17390 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:11:32.699057 17390 webserver.cc:460] Webserver started at http://127.10.249.131:36483/ using document root <none> and password file <none>
I20260810 04:11:32.699249 17390 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:32.699288 17390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:32.699395 17390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:32.700413 17390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "aa77c5603dc14c2b95ce7349a3bf3994"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "acfe4ea4aac54f4cf9fabcdcd0795b5e"
server_key_iv: "b99fd1194d9cccdecb426c48ff2dccee"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.700718 17390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "aa77c5603dc14c2b95ce7349a3bf3994"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "acfe4ea4aac54f4cf9fabcdcd0795b5e"
server_key_iv: "b99fd1194d9cccdecb426c48ff2dccee"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.701983 17390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:11:32.702646 17406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.702809 17390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:32.702924 17390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "aa77c5603dc14c2b95ce7349a3bf3994"
format_stamp: "Formatted at 2026-08-10 04:11:32 on dist-test-slave-0kls"
server_key: "acfe4ea4aac54f4cf9fabcdcd0795b5e"
server_key_iv: "b99fd1194d9cccdecb426c48ff2dccee"
server_key_version: "encryptionkey@0"
I20260810 04:11:32.702976 17390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:32.717032 17390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:32.719117 17390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:32.719264 17390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:32.719508 17390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:32.719858 17390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:32.719897 17390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.719950 17390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:32.719978 17390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:32.725684 17390 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:42391
I20260810 04:11:32.725739 17522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:42391 every 8 connection(s)
I20260810 04:11:32.726054 17390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:32.729504 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 17390
I20260810 04:11:32.729635 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:32.729867 11238 external_mini_cluster.cc:1428] Setting key 86d4648e80ef6566d3d096f6fa537174
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:11:32.735231 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.726780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:39025 (local address 127.10.249.190:36267)
0810 04:11:32.726828 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.726831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.727044 (+ 213us) server_negotiation.cc:407] Connection header received
0810 04:11:32.727946 (+ 902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.727947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.727958 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.728008 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.728546 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.728990 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.730164 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.730467 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.730534 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.732643 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:32.732644 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:32.732644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:32.732651 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:32.734133 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.734498 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.734499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.734499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.734549 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.734767 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.734767 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.734768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.734863 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:32.734913 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:32.735114 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 04:11:32.735170 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:11:32.735464 17525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.726774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:36267 (local address 127.10.249.131:39025)
0810 04:11:32.726931 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:32.726965 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:32.727867 (+ 902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:32.728060 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:32.728063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:32.728312 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:32.728484 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:32.728488 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.729057 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.729058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:32.730094 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:32.730097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.730702 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.730703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:32.730844 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.731288 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:32.731296 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:32.732564 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:32.734204 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:32.734209 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:32.734211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:32.734421 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:32.734601 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:32.734602 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:32.734602 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:32.734698 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:32.734913 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:32.734917 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:32.735024 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 04:11:32.735102 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 04:11:32.735211 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260810 04:11:32.735901 17523 heartbeater.cc:347] Connected to a master server at 127.10.249.190:36267
I20260810 04:11:32.736007 17523 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:32.736191 17523 heartbeater.cc:511] Master 127.10.249.190:36267 requested a full tablet report, sending...
I20260810 04:11:32.736543 17044 ts_manager.cc:194] Registered new tserver with Master: aa77c5603dc14c2b95ce7349a3bf3994 (127.10.249.131:42391)
I20260810 04:11:32.736892 17044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:39025
I20260810 04:11:32.741575 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/test-admin.keytab.
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.758024 11238 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 04:11:32.759805 17530 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:11:32.758870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57962 (local address 127.10.249.129:42187)
0810 04:11:32.759051 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.759062 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.759071 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:32.759096 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.759098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.759112 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.759193 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.759713 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57962: BlockingRecv error: recv got EOF from 127.0.0.1:57962 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":77,"threads_started":1}
W20260810 04:11:32.759878 11238 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5cc' of type FILE
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.760826 11238 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.761763 11238 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:32.769903 17530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.762339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57970 (local address 127.10.249.129:42187)
0810 04:11:32.762377 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.762379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.762414 (+ 35us) server_negotiation.cc:407] Connection header received
0810 04:11:32.762491 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.762492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.762503 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.762569 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.762985 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.763805 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.764570 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.764906 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.764986 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.767145 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:32.767158 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:32.767159 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:32.767166 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:32.768737 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.769071 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.769074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.769075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.769128 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.769310 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.769310 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.769311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.769438 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:32.769594 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:32.769680 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 04:11:32.769752 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 04:11:32.771644 17530 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:11:32.771117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57980 (local address 127.10.249.129:42187)
0810 04:11:32.771175 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.771177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.771208 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:11:32.771280 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.771281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.771291 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.771339 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.771597 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57980: BlockingRecv error: recv got EOF from 127.0.0.1:57980 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 04:11:32.771719 11238 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5cc' of type FILE
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.772580 11238 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.773392 11238 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:32.779917 17530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.773886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57982 (local address 127.10.249.129:42187)
0810 04:11:32.773940 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.773942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.774013 (+ 71us) server_negotiation.cc:407] Connection header received
0810 04:11:32.774074 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.774075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.774085 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.774139 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.774504 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.774974 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.775621 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.775818 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.775886 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.777583 (+ 1697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:32.777584 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:32.777584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:32.777591 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:32.778893 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.779226 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.779227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.779228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.779278 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.779457 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.779458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.779458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.779544 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:32.779635 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:32.779733 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 04:11:32.779830 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260810 04:11:32.781270 17530 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:11:32.780739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57984 (local address 127.10.249.129:42187)
0810 04:11:32.780797 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.780798 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.780832 (+ 34us) server_negotiation.cc:407] Connection header received
0810 04:11:32.780902 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.780903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.780911 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.780965 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.781228 (+ 263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57984: BlockingRecv error: recv got EOF from 127.0.0.1:57984 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 04:11:32.781327 11238 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786335069075394-11238-0/krb5kdc/krb5cc' of type FILE
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.782214 11238 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:32.783015 11238 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[16994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:11:32.788825 17530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:32.783430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57994 (local address 127.10.249.129:42187)
0810 04:11:32.783485 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:32.783487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:32.783507 (+ 20us) server_negotiation.cc:407] Connection header received
0810 04:11:32.783554 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:32.783555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:32.783562 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:32.783610 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:32.783917 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.784385 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.785011 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:32.785201 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:32.785254 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:32.787077 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:32.787078 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:32.787078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:32.787084 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:32.788089 (+ 1005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.788356 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.788357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.788357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.788398 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:32.788527 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:32.788527 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:32.788527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:32.788591 (+ 64us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:32.788650 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:32.788736 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 04:11:32.788780 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:11:32.789358 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 17110
I20260810 04:11:32.798314 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 17251
I20260810 04:11:32.803524 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 17390
I20260810 04:11:32.809113 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 17007
2026-08-10T04:11:32Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1811 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[17543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[17543](info): set up 2 sockets
Aug 10 04:11:32 dist-test-slave-0kls krb5kdc[17543](info): commencing operation
krb5kdc: starting...
W20260810 04:11:33.824733 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.995s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:11:33 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:11:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:11:33Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.190.keytab.
Entry for principal oryx/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.190.keytab.
I20260810 04:11:33.936462 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37879
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.190.keytab
--principal=oryx/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:37879
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:34.013396 17556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:34.013577 17556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:34.013598 17556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:34.014712 17556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:34.014750 17556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:34.014761 17556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:34.014772 17556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:34.014824 17556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:34.016098 17556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:37879
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.190.keytab
--principal=oryx/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:34.016322 17556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:34.016526 17556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:34.021196 17562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.021365 17556 server_base.cc:1034] running on GCE node
W20260810 04:11:34.021217 17564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.021201 17561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.021687 17556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:34.021983 17556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:34.023146 17556 hybrid_clock.cc:648] HybridClock initialized: now 1786335094023123 us; error 35 us; skew 500 ppm
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:34.025609 17556 init.cc:377] Logged in from keytab as oryx/127.10.249.190@KRBTEST.COM (short username oryx)
I20260810 04:11:34.026048 17556 webserver.cc:460] Webserver started at http://127.10.249.190:40533/ using document root <none> and password file <none>
I20260810 04:11:34.026268 17556 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:34.026310 17556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:34.026466 17556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:34.027662 17556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "7112ca50e5804375bb5f054255f51bb5"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "4d3506ea592fd8c91071ec9b4f69bb90"
server_key_iv: "26abb836333fb84d35d79c9ed31385fc"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.028069 17556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "7112ca50e5804375bb5f054255f51bb5"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "4d3506ea592fd8c91071ec9b4f69bb90"
server_key_iv: "26abb836333fb84d35d79c9ed31385fc"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.029356 17556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:34.030108 17571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.030292 17556 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:34.030392 17556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "7112ca50e5804375bb5f054255f51bb5"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "4d3506ea592fd8c91071ec9b4f69bb90"
server_key_iv: "26abb836333fb84d35d79c9ed31385fc"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.030457 17556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:34.045034 17556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:34.047371 17556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:34.047577 17556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:34.051899 17556 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:37879
I20260810 04:11:34.051925 17625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:37879 every 8 connection(s)
I20260810 04:11:34.052281 17556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:11:34.053284 17626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:34.055475 17626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: Bootstrap starting.
I20260810 04:11:34.055965 17626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:34.056190 17626 log.cc:824] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:34.056779 17626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: No bootstrap required, opened a new log
I20260810 04:11:34.058271 17626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } }
I20260810 04:11:34.058408 17626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:34.058429 17626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7112ca50e5804375bb5f054255f51bb5, State: Initialized, Role: FOLLOWER
I20260810 04:11:34.058571 17626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } }
I20260810 04:11:34.058655 17626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:11:34.058679 17626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:11:34.058714 17626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:34.059444 17626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } }
I20260810 04:11:34.059530 17626 leader_election.cc:302] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7112ca50e5804375bb5f054255f51bb5; no voters:
I20260810 04:11:34.059654 17626 leader_election.cc:288] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:11:34.059687 17629 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:34.059836 17629 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7112ca50e5804375bb5f054255f51bb5, State: Running, Role: LEADER
I20260810 04:11:34.059928 17629 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } }
I20260810 04:11:34.059960 17626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:34.060292 17631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7112ca50e5804375bb5f054255f51bb5. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } }
I20260810 04:11:34.060307 17630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } }
I20260810 04:11:34.060401 17630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:34.060773 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 17556
I20260810 04:11:34.060395 17631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:34.060930 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:11:34.060964 17638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:11:34.061129 11238 external_mini_cluster.cc:1428] Setting key 671f2cc07305f2e33a5bc6b1654391ba
I20260810 04:11:34.061463 17638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:11:34.063011 17638 catalog_manager.cc:1347] Generated new cluster ID: 0c991de091204b039be1cfc028999dac
I20260810 04:11:34.063117 17638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:11:34.068807 17638 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:11:34.069375 17638 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:11:34.072430 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.061605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49106 (local address 127.10.249.190:37879)
0810 04:11:34.061972 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.061982 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.062015 (+ 33us) server_negotiation.cc:407] Connection header received
0810 04:11:34.062128 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.062135 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.062199 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.062330 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.063099 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.064458 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.065446 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.065991 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.066083 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.068778 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.068782 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.068782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.068793 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.070575 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.070927 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.070930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.070931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.071016 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.071222 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.071222 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.071223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.071489 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.071616 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.072068 (+ 452us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.072203 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":129,"threads_started":1}
I20260810 04:11:34.077363 17638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: Generated new TSK 0
I20260810 04:11:34.077533 17638 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab.
Entry for principal oryx/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab.
I20260810 04:11:34.104455 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37879
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab
--principal=oryx/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:34.182664 17654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:34.182861 17654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:34.182883 17654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:34.184037 17654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:34.184077 17654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:34.184141 17654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:34.185451 17654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab
--principal=oryx/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:34.185674 17654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:34.185894 17654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:34.190601 17663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.190613 17660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.190601 17661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.190747 17654 server_base.cc:1034] running on GCE node
I20260810 04:11:34.190999 17654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:34.191206 17654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:34.192366 17654 hybrid_clock.cc:648] HybridClock initialized: now 1786335094192353 us; error 27 us; skew 500 ppm
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:34.194916 17654 init.cc:377] Logged in from keytab as oryx/127.10.249.129@KRBTEST.COM (short username oryx)
I20260810 04:11:34.195289 17654 webserver.cc:460] Webserver started at http://127.10.249.129:44701/ using document root <none> and password file <none>
I20260810 04:11:34.195508 17654 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:34.195554 17654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:34.195712 17654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:34.196568 17654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "a6693750f3f24a48a0c611bd5337c6de"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "07603b34e86714abd99861569afb66f6"
server_key_iv: "904aed26d3bfbbdd48fa24c126c17f42"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.196872 17654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "a6693750f3f24a48a0c611bd5337c6de"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "07603b34e86714abd99861569afb66f6"
server_key_iv: "904aed26d3bfbbdd48fa24c126c17f42"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.198097 17654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:11:34.198757 17670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.198930 17654 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.199018 17654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "a6693750f3f24a48a0c611bd5337c6de"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "07603b34e86714abd99861569afb66f6"
server_key_iv: "904aed26d3bfbbdd48fa24c126c17f42"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.199103 17654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:34.210121 17654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:34.212059 17654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:34.212152 17654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:34.212328 17654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:34.212598 17654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:34.212628 17654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.212646 17654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:34.212674 17654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.218612 17654 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:37739
I20260810 04:11:34.218675 17788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:37739 every 8 connection(s)
I20260810 04:11:34.218986 17654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:11:34.227521 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.219733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:37467 (local address 127.10.249.190:37879)
0810 04:11:34.219794 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.219796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.220007 (+ 211us) server_negotiation.cc:407] Connection header received
0810 04:11:34.220530 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.220531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.220544 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.220608 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.221527 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.222102 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.223089 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.223295 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.223367 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.225206 (+ 1839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.225207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.225208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.225213 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.226476 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.226817 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.226818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.226819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.226864 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.227052 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.227052 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.227052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.227141 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.227188 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.227400 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.227461 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:11:34.227667 17791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.219683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:37467)
0810 04:11:34.219879 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.219922 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.220423 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.220677 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.220681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.221255 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.221427 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.221432 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.222195 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.222196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.222984 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.222986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.223373 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.223375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.223506 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.223904 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.223912 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.225131 (+ 1219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.226549 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.226555 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.226557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.226758 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.226917 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.226917 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.226917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.227003 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.227194 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.227199 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.227299 (+ 100us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.227375 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.227479 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":105,"threads_started":1}
I20260810 04:11:34.228125 17789 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37879
I20260810 04:11:34.228229 17789 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:34.228387 17789 heartbeater.cc:511] Master 127.10.249.190:37879 requested a full tablet report, sending...
I20260810 04:11:34.228874 17588 ts_manager.cc:194] Registered new tserver with Master: a6693750f3f24a48a0c611bd5337c6de (127.10.249.129:37739)
I20260810 04:11:34.229028 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 17654
I20260810 04:11:34.229123 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:11:34.229311 11238 external_mini_cluster.cc:1428] Setting key 2d4a111ec24d3e81f3b24b7cb0d14cdc
I20260810 04:11:34.229651 17588 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:37467
WARNING: no policy specified for oryx/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab.
Entry for principal oryx/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab.
I20260810 04:11:34.253965 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37879
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab
--principal=oryx/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:34.327625 17794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:34.327790 17794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:34.327809 17794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:34.328835 17794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:34.328872 17794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:34.328918 17794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:34.330283 17794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab
--principal=oryx/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:34.330513 17794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:34.330711 17794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:34.335665 17800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.335739 17794 server_base.cc:1034] running on GCE node
W20260810 04:11:34.335708 17802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.335664 17799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.336138 17794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:34.336325 17794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:34.337472 17794 hybrid_clock.cc:648] HybridClock initialized: now 1786335094337462 us; error 39 us; skew 500 ppm
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:34.339654 17794 init.cc:377] Logged in from keytab as oryx/127.10.249.130@KRBTEST.COM (short username oryx)
I20260810 04:11:34.340102 17794 webserver.cc:460] Webserver started at http://127.10.249.130:40379/ using document root <none> and password file <none>
I20260810 04:11:34.340323 17794 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:34.340389 17794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:34.340533 17794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:34.341483 17794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "f8c1018acecb4824b5a7a76a8f622c9d"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "ee695f41905198e2be2ff0e38e1d9d5b"
server_key_iv: "58eb20b6489e7c04ab65b5667ef27802"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.341899 17794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "f8c1018acecb4824b5a7a76a8f622c9d"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "ee695f41905198e2be2ff0e38e1d9d5b"
server_key_iv: "58eb20b6489e7c04ab65b5667ef27802"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.343146 17794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:34.343858 17811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.344030 17794 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:34.344151 17794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "f8c1018acecb4824b5a7a76a8f622c9d"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "ee695f41905198e2be2ff0e38e1d9d5b"
server_key_iv: "58eb20b6489e7c04ab65b5667ef27802"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.344238 17794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:34.374636 17794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:34.376396 17794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:34.376549 17794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:34.376770 17794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:34.377074 17794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:34.377131 17794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.377178 17794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:34.377206 17794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.382638 17794 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:36441
I20260810 04:11:34.382678 17927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:36441 every 8 connection(s)
I20260810 04:11:34.383009 17794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:11:34.388651 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 17794
I20260810 04:11:34.388768 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:11:34.388978 11238 external_mini_cluster.cc:1428] Setting key c443756bba7bb2c89405dac9a437b771
I20260810 04:11:34.391619 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.383743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:56793 (local address 127.10.249.190:37879)
0810 04:11:34.383789 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.383791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.383989 (+ 198us) server_negotiation.cc:407] Connection header received
0810 04:11:34.384439 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.384440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.384449 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.384500 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.385303 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.385736 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.386585 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.386755 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.386803 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.388837 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.388839 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.388839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.388847 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.390199 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.390650 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.390651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.390651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.390697 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.390944 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.390945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.390945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.391031 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.391076 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.391414 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.391502 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:11:34.391774 17930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.383692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:56793)
0810 04:11:34.383861 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.383901 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.384362 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.384546 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.384549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.385048 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.385223 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.385228 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.385817 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.385818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.386518 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.386520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.386822 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.386823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.386917 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.387366 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.387374 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.388706 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.390272 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.390279 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.390281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.390572 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.390755 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.390756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.390756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.390886 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.391088 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.391094 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.391266 (+ 172us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.391375 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.391549 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260810 04:11:34.392238 17928 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37879
I20260810 04:11:34.392330 17928 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:34.392531 17928 heartbeater.cc:511] Master 127.10.249.190:37879 requested a full tablet report, sending...
I20260810 04:11:34.392942 17587 ts_manager.cc:194] Registered new tserver with Master: f8c1018acecb4824b5a7a76a8f622c9d (127.10.249.130:36441)
I20260810 04:11:34.393345 17587 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:56793
WARNING: no policy specified for oryx/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab.
Entry for principal oryx/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab.
I20260810 04:11:34.413905 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37879
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab
--principal=oryx/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:34.490345 17934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:34.490557 17934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:34.490592 17934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:34.491631 17934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:34.491688 17934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:34.491729 17934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:34.493122 17934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab
--principal=oryx/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:34.493373 17934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:34.493592 17934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:34.498337 17939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.498405 17940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.498337 17942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.498558 17934 server_base.cc:1034] running on GCE node
I20260810 04:11:34.498759 17934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:34.499001 17934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:34.500154 17934 hybrid_clock.cc:648] HybridClock initialized: now 1786335094500135 us; error 28 us; skew 500 ppm
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:34.502665 17934 init.cc:377] Logged in from keytab as oryx/127.10.249.131@KRBTEST.COM (short username oryx)
I20260810 04:11:34.503111 17934 webserver.cc:460] Webserver started at http://127.10.249.131:35459/ using document root <none> and password file <none>
I20260810 04:11:34.503342 17934 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:34.503410 17934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:34.503571 17934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:34.504554 17934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "b800beb1686e4da491579e4f086e101f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "80c9409d4adcddcf260fc20a89677975"
server_key_iv: "a1d3f2b8fde04b3198626860c26c04a1"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.504894 17934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "b800beb1686e4da491579e4f086e101f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "80c9409d4adcddcf260fc20a89677975"
server_key_iv: "a1d3f2b8fde04b3198626860c26c04a1"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.506140 17934 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:34.506752 17949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.506892 17934 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:34.507004 17934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "b800beb1686e4da491579e4f086e101f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "80c9409d4adcddcf260fc20a89677975"
server_key_iv: "a1d3f2b8fde04b3198626860c26c04a1"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.507071 17934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:34.526365 17934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:34.528060 17934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:34.528209 17934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:34.528406 17934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:34.528688 17934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:34.528719 17934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.528741 17934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:34.528784 17934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.534493 17934 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:36843
I20260810 04:11:34.534564 18066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:36843 every 8 connection(s)
I20260810 04:11:34.534866 17934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:11:34.538542 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 17934
I20260810 04:11:34.538635 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:11:34.538829 11238 external_mini_cluster.cc:1428] Setting key aae36ab760f6f7e50c25e820a34d535f
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:11:34.543439 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.535595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:45261 (local address 127.10.249.190:37879)
0810 04:11:34.535657 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.535659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.535842 (+ 183us) server_negotiation.cc:407] Connection header received
0810 04:11:34.536275 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.536276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.536285 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.536332 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.537111 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.537529 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.538406 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.538670 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.538746 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.540904 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.540917 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.540918 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.540925 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.542078 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.542483 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.542485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.542486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.542545 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.542794 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.542795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.542795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.542902 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.542973 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.543270 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.543350 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:11:34.543612 18069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.535568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:45261)
0810 04:11:34.535729 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.535768 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.536198 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.536386 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.536389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.536890 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.537049 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.537053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.537598 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.537599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.538326 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.538328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.538757 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.538758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.538848 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.539307 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.539317 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.540809 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.542174 (+ 1365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.542181 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.542183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.542396 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.542621 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.542622 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.542623 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.542729 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.542965 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.542971 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.543126 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.543233 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.543387 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260810 04:11:34.544052 18067 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37879
I20260810 04:11:34.544143 18067 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:34.544303 18067 heartbeater.cc:511] Master 127.10.249.190:37879 requested a full tablet report, sending...
I20260810 04:11:34.544603 17587 ts_manager.cc:194] Registered new tserver with Master: b800beb1686e4da491579e4f086e101f (127.10.249.131:36843)
I20260810 04:11:34.544896 17587 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:45261
I20260810 04:11:34.550402 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.249.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.189.keytab.
Entry for principal oryx/127.10.249.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.189.keytab.
I20260810 04:11:34.574753 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.189:44473
--webserver_interface=127.10.249.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.189.keytab
--principal=oryx/127.10.249.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:37879,127.10.249.189:44473
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:34.653721 18072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:34.653925 18072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:34.653947 18072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:34.654994 18072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:34.655023 18072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:34.655036 18072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:34.655048 18072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:34.655058 18072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:34.656312 18072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:37879,127.10.249.189:44473
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.189.keytab
--principal=oryx/127.10.249.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.189:44473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.249.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
W20260810 04:11:34.656401 18072 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.249.190:37879,127.10.249.189:44473'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 04:11:34.656505 18072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:34.656653 18072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:34.661221 18078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.661226 18080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.661217 18077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.661424 18072 server_base.cc:1034] running on GCE node
I20260810 04:11:34.661773 18072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:34.662066 18072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:34.663218 18072 hybrid_clock.cc:648] HybridClock initialized: now 1786335094663204 us; error 47 us; skew 500 ppm
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:34.665396 18072 init.cc:377] Logged in from keytab as oryx/127.10.249.189@KRBTEST.COM (short username oryx)
I20260810 04:11:34.665882 18072 webserver.cc:460] Webserver started at http://127.10.249.189:44499/ using document root <none> and password file <none>
I20260810 04:11:34.666111 18072 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:34.666178 18072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:34.666333 18072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:34.667323 18072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data/instance:
uuid: "cd42d8f6ef7b434f89e65b3933acc4b2"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "01af57a11493073f963308bdb3fccdcc"
server_key_iv: "126e216c18e661329c9d7e954f5096e2"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.667678 18072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal/instance:
uuid: "cd42d8f6ef7b434f89e65b3933acc4b2"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "01af57a11493073f963308bdb3fccdcc"
server_key_iv: "126e216c18e661329c9d7e954f5096e2"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.668924 18072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:11:34.669607 18089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.669842 18072 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:11:34.669951 18072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
uuid: "cd42d8f6ef7b434f89e65b3933acc4b2"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "01af57a11493073f963308bdb3fccdcc"
server_key_iv: "126e216c18e661329c9d7e954f5096e2"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.670032 18072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:34.684196 18072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:34.686024 18072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:34.686179 18072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:34.690196 18072 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.189:44473
I20260810 04:11:34.690228 18144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.189:44473 every 8 connection(s)
I20260810 04:11:34.690594 18072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
I20260810 04:11:34.691598 18145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:34.693194 18145 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.189@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:11:34.699833 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 18072
I20260810 04:11:34.702867 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.693962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49110 (local address 127.10.249.190:37879)
0810 04:11:34.694028 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.694031 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.694227 (+ 196us) server_negotiation.cc:407] Connection header received
0810 04:11:34.694760 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.694761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.694774 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.694836 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.695476 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.695978 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.696943 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.697148 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.697222 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.699441 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.699443 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.699443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.699451 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.701420 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.701846 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.701847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.701848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.701921 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.702172 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.702173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.702173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.702357 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.702435 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.702694 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.702759 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:11:34.703111 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.693912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49110)
0810 04:11:34.694085 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.694121 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.694633 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.694911 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.694915 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.695186 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.695374 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.695378 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.696066 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.696068 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.696851 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.696854 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.697240 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.697241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.697363 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.697903 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.697920 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.699334 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.701495 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.701499 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.701501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.701753 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.701984 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.701985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.701985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.702106 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.702433 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.702437 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.702571 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.702669 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.702820 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260810 04:11:34.703704 18145 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.249.189@KRBTEST.COM
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.189@KRBTEST.COM for oryx/127.10.249.189@KRBTEST.COM
I20260810 04:11:34.709223 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.700406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.10.249.189:44473)
0810 04:11:34.700632 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.700636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.700682 (+ 46us) server_negotiation.cc:407] Connection header received
0810 04:11:34.700771 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.700774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.700786 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.700841 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.701675 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.702723 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.703759 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.704198 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.704282 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.706410 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.706417 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.706417 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.706424 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.708114 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.708449 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.708452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.708452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.708506 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.708695 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.708696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.708696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.708821 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.709017 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.709053 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.709119 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":80,"threads_started":1}
I20260810 04:11:34.711356 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.704027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.0.0.1:50022)
0810 04:11:34.704060 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.704071 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.704111 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.704330 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.704330 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.704466 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.704514 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.704515 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.705131 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.705132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.705555 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.705556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.706018 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.706019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.706081 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.706504 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.706509 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.708011 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.710603 (+ 2592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.710604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.710604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.710791 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.710975 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.710975 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.710975 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.711012 (+ 37us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.711188 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.711189 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.711215 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.711252 (+ 37us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.711309 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260810 04:11:34.711479 18150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.704046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.10.249.189:44473)
0810 04:11:34.704205 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.704206 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.704212 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:11:34.704228 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.704229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.704244 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.704327 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.704594 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.705035 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.705637 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.705927 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.706016 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.708112 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.708113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.708113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.708120 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.710497 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.710857 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.710858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.710858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.710925 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.711054 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.711055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.711055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.711143 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.711195 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.711274 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.711353 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260810 04:11:34.712579 18145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Bootstrap starting.
I20260810 04:11:34.713194 18145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:34.713481 18145 log.cc:824] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:34.714248 18145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: No bootstrap required, opened a new log
I20260810 04:11:34.715408 18145 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } }
I20260810 04:11:34.715533 18145 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:34.715574 18145 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd42d8f6ef7b434f89e65b3933acc4b2, State: Initialized, Role: FOLLOWER
I20260810 04:11:34.715691 18145 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } }
I20260810 04:11:34.716024 18145 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:34.715992 18152 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } } }
I20260810 04:11:34.716122 18152 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:11:34.717914 18163 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:11:34.717967 18163 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:11:34.719619 18072 master_runner.cc:428] Detected that this master cd42d8f6ef7b434f89e65b3933acc4b2 is joining an existing cluster
I20260810 04:11:34.719696 18072 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.249.189:44473
I20260810 04:11:34.727619 18150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.720759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50024 (local address 127.10.249.189:44473)
0810 04:11:34.720794 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.720795 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.720963 (+ 168us) server_negotiation.cc:407] Connection header received
0810 04:11:34.721050 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.721050 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.721057 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.721098 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.721511 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.722078 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.723064 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.723347 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.723376 (+ 29us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.724444 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.724445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.724446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.724460 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.726226 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.726783 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.726783 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.726784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.726831 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.727076 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.727077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.727078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.727183 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.727250 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.727406 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.727538 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":17}
I20260810 04:11:34.727620 18171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.720683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.0.0.1:50024)
0810 04:11:34.720913 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.720922 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.720980 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.721113 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.721113 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.721366 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.721439 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.721441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.722137 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.722137 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.722958 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.722960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.723431 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.723431 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.723467 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.723896 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.723902 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.724322 (+ 420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.726318 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.726319 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.726319 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.726686 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.726896 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.726897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.726897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.726993 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.727254 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.727254 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.727299 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.727379 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.727485 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":3,"thread_start_us":93,"threads_started":1}
I20260810 04:11:34.727993 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.720840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.10.249.190:37879)
0810 04:11:34.720886 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.720889 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.720910 (+ 21us) server_negotiation.cc:407] Connection header received
0810 04:11:34.720984 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.720985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.720995 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.721063 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.721515 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.722255 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.723254 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.723550 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.723617 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.724601 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.724603 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.724603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.724611 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.726329 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.726741 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.726743 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.726743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.726805 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.727041 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.727042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.727043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.727183 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.727253 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.727825 (+ 572us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.727905 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:11:34.728283 18170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.720681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49112)
0810 04:11:34.720849 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.720860 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.720923 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.721128 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.721128 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.721363 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.721439 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.721441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.722333 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.722334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.723174 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.723175 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.723672 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.723674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.723742 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.724065 (+ 323us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.724070 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.724511 (+ 441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.726395 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.726396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.726397 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.726665 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.726883 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.726884 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.726884 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.726956 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.727647 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.727647 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.727685 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.728079 (+ 394us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.728189 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":3,"spinlock_wait_cycles":9088,"thread_start_us":96,"threads_started":1}
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.190@KRBTEST.COM for oryx/127.10.249.189@KRBTEST.COM
I20260810 04:11:34.738065 18150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.730746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50032 (local address 127.10.249.189:44473)
0810 04:11:34.730784 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.730785 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.730873 (+ 88us) server_negotiation.cc:407] Connection header received
0810 04:11:34.730971 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.730972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.730980 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.731034 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.731517 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.731962 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.733045 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.733268 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.733342 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.735518 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.735519 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.735520 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.735526 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.736845 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.737260 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.737261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.737261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.737319 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.737523 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.737524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.737524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.737626 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.737694 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.737918 (+ 224us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.737988 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:11:34.738101 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.730644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.0.0.1:50032)
0810 04:11:34.730777 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.730825 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.730899 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.731044 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.731047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.731390 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.731446 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.731448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.732034 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.732035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.732934 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.732937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.733356 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.733357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.733443 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.733970 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.733974 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.735421 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.736946 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.736954 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.736956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.737170 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.737390 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.737391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.737391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.737454 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.737698 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.737706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.737755 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.737877 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.737994 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":77,"threads_started":1}
I20260810 04:11:34.738768 17587 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.249.189:44473: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2"
member_type: NON_VOTER
last_known_addr {
host: "127.10.249.189"
port: 44473
}
attrs {
promote: true
}
}
dest_uuid: "7112ca50e5804375bb5f054255f51bb5"
cas_config_opid_index: -1
I20260810 04:11:34.739074 17587 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } }
I20260810 04:11:34.739534 18174 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER cd42d8f6ef7b434f89e65b3933acc4b2 (127.10.249.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } }
I20260810 04:11:34.739919 18118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:34.740953 18174 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.249.189:44473
I20260810 04:11:34.740983 18118 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Refusing update from remote peer 7112ca50e5804375bb5f054255f51bb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 04:11:34.741297 18072 master.cc:537] Master@127.10.249.189:44473 shutting down...
I20260810 04:11:34.741317 18174 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:34.741791 18173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } }
I20260810 04:11:34.741897 18173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: This master's current role is: LEADER
W20260810 04:11:34.742080 17574 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260810 04:11:34.742436 17574 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 -> Peer cd42d8f6ef7b434f89e65b3933acc4b2 (127.10.249.189:44473): Couldn't send request to peer cd42d8f6ef7b434f89e65b3933acc4b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 04:11:34.744146 18072 raft_consensus.cc:2229] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:34.744261 18072 raft_consensus.cc:2258] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:34.744309 18072 tablet_replica.cc:330] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: stopping tablet replica
I20260810 04:11:34.756963 18072 master.cc:552] Master@127.10.249.189:44473 shutdown complete.
I20260810 04:11:34.757018 18072 master_runner.cc:305] Clearing existing system tablet
I20260810 04:11:34.757144 18072 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:34.757210 18072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:34.757810 18072 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:34.758278 18179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.758438 18072 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:34.758507 18072 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.758533 18072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
uuid: "cd42d8f6ef7b434f89e65b3933acc4b2"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "01af57a11493073f963308bdb3fccdcc"
server_key_iv: "126e216c18e661329c9d7e954f5096e2"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.759339 18072 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:34.761143 18072 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 04:11:34.761210 18072 log.cc:1196] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 04:11:34.761415 18072 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Deleting consensus metadata
I20260810 04:11:34.761538 18072 master_runner.cc:315] Copying system tablet from 127.10.249.190:37879
I20260810 04:11:34.762229 18072 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.249.190:37879
I20260810 04:11:34.768394 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.762464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49126)
0810 04:11:34.762604 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.762614 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.762679 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.762813 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.762813 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.762958 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.763015 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.763016 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.763933 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.763933 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.764452 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.764453 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.764921 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.764921 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.764967 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.765443 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.765448 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.765753 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.767473 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.767474 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.767474 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.767638 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.767849 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.767850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.767850 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.767899 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.768167 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.768167 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.768202 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.768251 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.768322 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260810 04:11:34.768435 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.762558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49126 (local address 127.10.249.190:37879)
0810 04:11:34.762616 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.762618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.762661 (+ 43us) server_negotiation.cc:407] Connection header received
0810 04:11:34.762738 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.762739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.762750 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.762811 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.763087 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.763854 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.764525 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.764850 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.764917 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.765897 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.765899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.765900 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.765907 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.767401 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.767705 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.767706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.767706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.767780 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.767973 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.767973 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.767974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.768104 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.768175 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.768274 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.768349 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:11:34.768735 17610 tablet_copy_service.cc:140] P 7112ca50e5804375bb5f054255f51bb5: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer cd42d8f6ef7b434f89e65b3933acc4b2 ({username='oryx', principal='oryx/127.10.249.189@KRBTEST.COM'} at 127.0.0.1:49126)
I20260810 04:11:34.768839 17610 tablet_copy_service.cc:161] P 7112ca50e5804375bb5f054255f51bb5: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer cd42d8f6ef7b434f89e65b3933acc4b2 at {username='oryx', principal='oryx/127.10.249.189@KRBTEST.COM'} at 127.0.0.1:49126: session id = cd42d8f6ef7b434f89e65b3933acc4b2-00000000000000000000000000000000
I20260810 04:11:34.769438 17610 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 04:11:34.770084 18072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 04:11:34.771212 18072 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: tablet copy: Starting download of 0 data blocks...
I20260810 04:11:34.771353 18072 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: tablet copy: Starting download of 1 WAL segments...
I20260810 04:11:34.772168 18072 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 04:11:34.773061 17610 tablet_copy_service.cc:342] P 7112ca50e5804375bb5f054255f51bb5: Request end of tablet copy session cd42d8f6ef7b434f89e65b3933acc4b2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.249.189@KRBTEST.COM'} at 127.0.0.1:49126
I20260810 04:11:34.773118 17610 tablet_copy_service.cc:433] P 7112ca50e5804375bb5f054255f51bb5: ending tablet copy session cd42d8f6ef7b434f89e65b3933acc4b2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer cd42d8f6ef7b434f89e65b3933acc4b2
I20260810 04:11:34.775611 18072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:34.776731 18189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.776845 18187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.776970 18072 server_base.cc:1034] running on GCE node
W20260810 04:11:34.777954 18186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.778110 18072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:34.778301 18072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:34.779428 18072 hybrid_clock.cc:648] HybridClock initialized: now 1786335094779421 us; error 24 us; skew 500 ppm
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:34.780833 18072 init.cc:377] Logged in from keytab as oryx/127.10.249.189@KRBTEST.COM (short username oryx)
I20260810 04:11:34.781153 18072 webserver.cc:460] Webserver started at http://127.10.249.189:36827/ using document root <none> and password file <none>
I20260810 04:11:34.781270 18072 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:34.781318 18072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:34.781889 18072 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:34.782385 18196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.782531 18072 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.782583 18072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
uuid: "cd42d8f6ef7b434f89e65b3933acc4b2"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "01af57a11493073f963308bdb3fccdcc"
server_key_iv: "126e216c18e661329c9d7e954f5096e2"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.782631 18072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:34.800601 18072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:34.802278 18072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:34.805410 18072 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.189:44473
I20260810 04:11:34.805708 18251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.189:44473 every 8 connection(s)
I20260810 04:11:34.805847 18072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
I20260810 04:11:34.806543 18252 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:11:34.806950 18252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Bootstrap starting.
I20260810 04:11:34.809113 18252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:11:34.809329 18252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: Bootstrap complete.
I20260810 04:11:34.809525 18252 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } }
I20260810 04:11:34.809659 18252 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd42d8f6ef7b434f89e65b3933acc4b2, State: Initialized, Role: LEARNER
I20260810 04:11:34.809718 18252 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } }
I20260810 04:11:34.809907 18252 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:34.809897 18255 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } }
I20260810 04:11:34.809990 18255 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: This master's current role is: LEARNER
I20260810 04:11:34.811502 18268 catalog_manager.cc:1259] Loaded cluster ID: 0c991de091204b039be1cfc028999dac
I20260810 04:11:34.812114 18268 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: loading cluster ID for follower catalog manager: success
I20260810 04:11:34.813447 18268 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: acquiring CA information for follower catalog manager: success
I20260810 04:11:34.813736 18268 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:11:34.818073 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.810761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50046 (local address 127.10.249.189:44473)
0810 04:11:34.811285 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.811287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.811297 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:34.811320 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.811321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.811332 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.812024 (+ 692us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.812093 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.813075 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.814132 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.814340 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.814388 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.815630 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.815631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.815631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.815636 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.816964 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.817334 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.817335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.817335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.817383 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.817593 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.817593 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.817594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.817687 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.817754 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.817919 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.817988 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for oryx/127.10.249.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.188.keytab.
Entry for principal oryx/127.10.249.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.188.keytab.
I20260810 04:11:34.847983 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.188:41101
--webserver_interface=127.10.249.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.188.keytab
--principal=oryx/127.10.249.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:34.933820 18271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:34.934005 18271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:34.934027 18271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:34.935106 18271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:11:34.935160 18271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:34.935173 18271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:34.935184 18271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:11:34.935230 18271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:11:34.936565 18271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.188.keytab
--principal=oryx/127.10.249.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.188:41101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.249.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:34.936796 18271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:34.936991 18271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:11:34.941617 18271 server_base.cc:1034] running on GCE node
W20260810 04:11:34.941681 18279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.941622 18276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:34.941751 18277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:34.942054 18271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:34.942342 18271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:34.943500 18271 hybrid_clock.cc:648] HybridClock initialized: now 1786335094943494 us; error 36 us; skew 500 ppm
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:34.945894 18271 init.cc:377] Logged in from keytab as oryx/127.10.249.188@KRBTEST.COM (short username oryx)
I20260810 04:11:34.946249 18271 webserver.cc:460] Webserver started at http://127.10.249.188:46033/ using document root <none> and password file <none>
I20260810 04:11:34.946437 18271 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:34.946524 18271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:34.946638 18271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:11:34.947685 18271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data/instance:
uuid: "c92010f417d2440181036bddfc26021f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "9631ed92ebe6cb1281150ef076133c78"
server_key_iv: "cc7a5948ea9211a04769b33afbc93b20"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.947993 18271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal/instance:
uuid: "c92010f417d2440181036bddfc26021f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "9631ed92ebe6cb1281150ef076133c78"
server_key_iv: "cc7a5948ea9211a04769b33afbc93b20"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.949141 18271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:11:34.949723 18286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.949891 18271 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:34.949985 18271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
uuid: "c92010f417d2440181036bddfc26021f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "9631ed92ebe6cb1281150ef076133c78"
server_key_iv: "cc7a5948ea9211a04769b33afbc93b20"
server_key_version: "encryptionkey@0"
I20260810 04:11:34.950057 18271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:34.963093 18271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:34.964676 18271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:34.964807 18271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:34.969251 18271 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.188:41101
I20260810 04:11:34.969278 18338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.188:41101 every 8 connection(s)
I20260810 04:11:34.969600 18271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
I20260810 04:11:34.970599 18339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:34.971880 18339 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:11:34.973035 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 18271
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.188@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.249.188@KRBTEST.COM
I20260810 04:11:34.981518 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.972717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49142 (local address 127.10.249.190:37879)
0810 04:11:34.972794 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.972796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.972937 (+ 141us) server_negotiation.cc:407] Connection header received
0810 04:11:34.973616 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.973618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.973633 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.973691 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.974375 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.974957 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.976080 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.976349 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.976421 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.978570 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.978572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.978572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.978580 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.980178 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.980584 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.980586 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.980587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.980656 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.980883 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.980883 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.980884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.981040 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.981108 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.981358 (+ 250us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.981437 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 04:11:34.981648 18341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.972481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49142)
0810 04:11:34.972742 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.972779 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.973466 (+ 687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.973767 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.973771 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.974126 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.974280 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.974284 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.975040 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.975041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.975987 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.975989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.976455 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.976456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.976567 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.977020 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.977027 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.978496 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.980267 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.980273 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.980275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.980487 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.980727 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.980727 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.980728 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.980817 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.981112 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.981118 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.981237 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.981333 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.981456 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":155,"thread_start_us":169,"threads_started":1}
I20260810 04:11:34.982169 18339 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:11:34.982357 18342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.973558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40144 (local address 127.10.249.188:41101)
0810 04:11:34.973704 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.973708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.973723 (+ 15us) server_negotiation.cc:407] Connection header received
0810 04:11:34.973762 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.973764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.973804 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.973981 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.974678 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.975642 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.976426 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.976800 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.976855 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.979273 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.979279 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.979279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.979286 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.980869 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.981209 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.981212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.981212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.981268 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.981484 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.981485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.981485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.981652 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.981846 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.982095 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.982161 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.188@KRBTEST.COM for oryx/127.10.249.189@KRBTEST.COM
I20260810 04:11:34.988014 18341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.982429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.0.0.1:50060)
0810 04:11:34.982458 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.982468 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.982505 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.982647 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.982648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.982772 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.982795 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.982796 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.983518 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.983519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.984046 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.984047 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.984439 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.984441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.984490 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.984783 (+ 293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.984787 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.985894 (+ 1107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.987118 (+ 1224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.987119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.987119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.987264 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.987444 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.987445 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.987445 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.987492 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.987757 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.987758 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.987794 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.987857 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.987939 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260810 04:11:34.988054 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.982504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50060 (local address 127.10.249.189:44473)
0810 04:11:34.982551 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.982553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.982560 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:11:34.982582 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.982583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.982591 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.982643 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.982872 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.983441 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.984130 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.984372 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.984442 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.985976 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.985977 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.985977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.985984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.987045 (+ 1061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.987328 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.987329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.987330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.987380 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.987574 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.987575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.987575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.987679 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.987765 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.987886 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.987960 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:11:34.988415 18339 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 41101 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:11:34 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.188@KRBTEST.COM for oryx/127.10.249.188@KRBTEST.COM
I20260810 04:11:34.992959 18341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.988627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:41101 (local address 127.0.0.1:40158)
0810 04:11:34.988674 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:34.988683 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:34.988720 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:34.988801 (+ 81us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:34.988802 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:34.988892 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:34.988914 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.988915 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.989385 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.989386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.989749 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:34.989750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.990074 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.990075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:34.990106 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.990421 (+ 315us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:34.990425 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:34.991332 (+ 907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:34.992381 (+ 1049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.992381 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.992382 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.992515 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.992641 (+ 126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:34.992641 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:34.992642 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:34.992676 (+ 34us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:34.992800 (+ 124us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:34.992801 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:34.992824 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 04:11:34.992861 (+ 37us) client_negotiation.cc:240] Negotiation successful
0810 04:11:34.992914 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 04:11:34.993032 18342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:34.988681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40158 (local address 127.10.249.188:41101)
0810 04:11:34.988731 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:34.988732 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:34.988738 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:11:34.988754 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:34.988755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:34.988761 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:34.988800 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:34.988968 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.989324 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.989846 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:34.990012 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:34.990054 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:34.991394 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:34.991395 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:34.991395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:34.991401 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:34.992322 (+ 921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.992567 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.992567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.992568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.992606 (+ 38us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:34.992704 (+ 98us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:34.992705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:34.992705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:34.992772 (+ 67us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:34.992807 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:34.992874 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 04:11:34.992951 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":28}
I20260810 04:11:34.994351 18339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Bootstrap starting.
I20260810 04:11:34.995059 18339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:34.995316 18339 log.cc:824] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:34.995882 18339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: No bootstrap required, opened a new log
I20260810 04:11:34.997108 18339 raft_consensus.cc:348] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 41101 } }
I20260810 04:11:34.997213 18339 raft_consensus.cc:374] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:34.997234 18339 raft_consensus.cc:729] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c92010f417d2440181036bddfc26021f, State: Initialized, Role: FOLLOWER
I20260810 04:11:34.997347 18339 consensus_queue.cc:260] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 41101 } }
I20260810 04:11:34.997622 18339 sys_catalog.cc:564] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:34.997598 18344 sys_catalog.cc:455] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 41101 } } }
I20260810 04:11:34.997756 18344 sys_catalog.cc:458] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:11:34.999136 18356 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:11:34.999189 18356 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:11:35.001333 18271 master_runner.cc:428] Detected that this master c92010f417d2440181036bddfc26021f is joining an existing cluster
I20260810 04:11:35.001380 18271 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.249.188:41101
I20260810 04:11:35.009090 18364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.002430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.0.0.1:50076)
0810 04:11:35.003022 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.003032 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.003109 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.003310 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.003311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.003510 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.003587 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.003589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.004494 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.004494 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.005383 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.005385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.006051 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.006052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.006100 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.006463 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.006468 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.006790 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.008132 (+ 1342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.008133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.008133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.008305 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.008489 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.008489 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.008490 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.008541 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.008780 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.008782 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.008830 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.008906 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.008997 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":97,"threads_started":1}
I20260810 04:11:35.009095 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.002647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50076 (local address 127.10.249.189:44473)
0810 04:11:35.002690 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.002692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.003081 (+ 389us) server_negotiation.cc:407] Connection header received
0810 04:11:35.003202 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.003203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.003214 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.003245 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.003671 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.004413 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.005481 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.005755 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.005790 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.006874 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.006876 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.006876 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.006882 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.008060 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.008372 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.008373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.008374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.008421 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.008607 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.008608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.008608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.008714 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.008777 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.008928 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.008995 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:11:35.033846 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 17654
I20260810 04:11:35.038416 18342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.003190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40174 (local address 127.10.249.188:41101)
0810 04:11:35.003224 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.003226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.003459 (+ 233us) server_negotiation.cc:407] Connection header received
0810 04:11:35.003539 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.003539 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.003546 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.003573 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.003974 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.004604 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.005584 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.005874 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.005921 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.035132 (+ 29211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.035133 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.035133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.035140 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.036849 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.037315 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.037316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.037317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.037375 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.037577 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.037578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.037578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.037704 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.037746 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.037972 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.038328 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:11:35.039091 18365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.003125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:41101 (local address 127.0.0.1:40174)
0810 04:11:35.003412 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.003420 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.003477 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.003621 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.003622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.003835 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.003898 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.003899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.004687 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.004687 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.005521 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.005522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.005989 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.005990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.006045 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.034564 (+ 28519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.034570 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.035029 (+ 459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.036947 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.036947 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.036948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.037214 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.037442 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.037443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.037443 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.037511 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.037829 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.037830 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.037871 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.038875 (+ 1004us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.038983 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":37,"thread_start_us":76,"threads_started":1}
I20260810 04:11:35.042241 18362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.002430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49156)
0810 04:11:35.003267 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.003276 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.003328 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.003501 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.003502 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.003724 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.003785 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.003786 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.004694 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.004695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.005552 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.005555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.006096 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.006096 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.006155 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.037128 (+ 30973us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.037134 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.037611 (+ 477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.041159 (+ 3548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.041160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.041161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.041365 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.041572 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.041572 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.041573 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.041633 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.041910 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.041911 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.041951 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.042028 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.042137 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"mutex_wait_us":2,"thread_start_us":523,"threads_started":1}
I20260810 04:11:35.042291 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.002475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49156 (local address 127.10.249.190:37879)
0810 04:11:35.002510 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.002512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.003337 (+ 825us) server_negotiation.cc:407] Connection header received
0810 04:11:35.003383 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.003384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.003395 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.003456 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.003881 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.004594 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.005646 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.005985 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.006025 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.037736 (+ 31711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.037737 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.037738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.037748 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.041069 (+ 3321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.041445 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.041446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.041447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.041504 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.041696 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.041697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.041697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.041848 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.041910 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.042062 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.042161 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:11:35.043287 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:37739
--local_ip_for_outbound_sockets=127.10.249.129
--tserver_master_addrs=127.10.249.190:37879
--webserver_port=44701
--webserver_interface=127.10.249.129
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab
--principal=oryx/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335094, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.190@KRBTEST.COM for oryx/127.10.249.188@KRBTEST.COM
I20260810 04:11:35.052302 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.044723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:41101 (local address 127.0.0.1:40190)
0810 04:11:35.044801 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.044811 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.044843 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.045110 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.045111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.045283 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.045332 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.045334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.046167 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.046169 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.047004 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.047007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.047409 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.047411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.047489 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.047876 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.047881 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.049334 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.051103 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.051104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.051104 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.051313 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.051523 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.051524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.051524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.051589 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.051908 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.051910 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.051953 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.052050 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.052161 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 04:11:35.052922 18342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.044901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40190 (local address 127.10.249.188:41101)
0810 04:11:35.044961 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.044963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.044972 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:11:35.045004 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.045004 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.045014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.045077 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.045411 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.046063 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.047080 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.047329 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.047399 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.049437 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.049438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.049438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.049446 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.051016 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.051390 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.051391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.051392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.051446 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.051658 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.051659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.051659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.051817 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.051880 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.052684 (+ 804us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.052753 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:11:35.054431 17587 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.249.188:41101: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c92010f417d2440181036bddfc26021f"
member_type: NON_VOTER
last_known_addr {
host: "127.10.249.188"
port: 41101
}
attrs {
promote: true
}
}
dest_uuid: "7112ca50e5804375bb5f054255f51bb5"
cas_config_opid_index: 5
I20260810 04:11:35.054668 17587 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:35.055279 18174 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c92010f417d2440181036bddfc26021f (127.10.249.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.055392 18313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:35.056185 18174 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.249.188:41101
I20260810 04:11:35.056195 18313 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 1 FOLLOWER]: Refusing update from remote peer 7112ca50e5804375bb5f054255f51bb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 04:11:35.056264 18174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.056339 18174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:35.056532 18271 master.cc:537] Master@127.10.249.188:41101 shutting down...
I20260810 04:11:35.056526 18173 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 04:11:35.057139 17575 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 -> Peer c92010f417d2440181036bddfc26021f (127.10.249.188:41101): Couldn't send request to peer c92010f417d2440181036bddfc26021f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 04:11:35.060024 18271 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:35.060122 18271 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:35.060166 18271 tablet_replica.cc:330] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: stopping tablet replica
I20260810 04:11:35.062216 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.055203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50090 (local address 127.10.249.189:44473)
0810 04:11:35.055246 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.055247 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.057316 (+ 2069us) server_negotiation.cc:407] Connection header received
0810 04:11:35.057418 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.057419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.057442 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.057481 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:35.058499 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.059159 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.060792 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.061363 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.061411 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.061475 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.062109 (+ 634us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.062157 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:11:35.062511 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.055105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.0.0.1:50090)
0810 04:11:35.057262 (+ 2157us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.057272 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.057343 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.057569 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.057570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.057571 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:35.057604 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.057606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.059383 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.059384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.060680 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.060684 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.061958 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.061958 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.062018 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.062038 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.062417 (+ 379us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.062454 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2142}
I20260810 04:11:35.062901 18224 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 LEARNER]: Refusing update from remote peer 7112ca50e5804375bb5f054255f51bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 04:11:35.063117 18173 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 04:11:35.063666 18224 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c92010f417d2440181036bddfc26021f (127.10.249.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.064971 18255 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7112ca50e5804375bb5f054255f51bb5. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.065043 18255 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: This master's current role is: LEARNER
I20260810 04:11:35.065096 18255 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: NON_VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: true } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.065132 18255 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: This master's current role is: LEARNER
I20260810 04:11:35.065419 18175 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: attempting to promote NON_VOTER cd42d8f6ef7b434f89e65b3933acc4b2 to VOTER
I20260810 04:11:35.065621 18175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:35.066421 18224 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 LEARNER]: Refusing update from remote peer 7112ca50e5804375bb5f054255f51bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 04:11:35.066511 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.066382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:41101 (local address 127.0.0.1:40206)
0810 04:11:35.066422 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.066474 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 04:11:35.066663 18173 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 04:11:35.066802 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.066731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:41101 (local address 127.0.0.1:40216)
0810 04:11:35.066762 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.066782 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260810 04:11:35.066860 17575 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 -> Peer c92010f417d2440181036bddfc26021f (127.10.249.188:41101): Couldn't send request to peer c92010f417d2440181036bddfc26021f. Status: Network error: Client connection negotiation failed: client connection to 127.10.249.188:41101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 04:11:35.067487 18174 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, cd42d8f6ef7b434f89e65b3933acc4b2 (127.10.249.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.067590 18224 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, cd42d8f6ef7b434f89e65b3933acc4b2 (127.10.249.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.068369 18174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.068450 18174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:35.068512 18174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.068569 18174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:11:35.068645 18368 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7112ca50e5804375bb5f054255f51bb5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.068797 18368 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:11:35.073165 18271 master.cc:552] Master@127.10.249.188:41101 shutdown complete.
I20260810 04:11:35.073217 18271 master_runner.cc:305] Clearing existing system tablet
I20260810 04:11:35.073343 18271 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:35.073391 18271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:35.074201 18271 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:11:35.074759 18370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.074895 18271 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:35.074945 18271 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:11:35.074970 18271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
uuid: "c92010f417d2440181036bddfc26021f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "9631ed92ebe6cb1281150ef076133c78"
server_key_iv: "cc7a5948ea9211a04769b33afbc93b20"
server_key_version: "encryptionkey@0"
I20260810 04:11:35.075749 18271 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:35.077360 18271 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 04:11:35.077515 18271 log.cc:1196] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 04:11:35.077754 18271 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Deleting consensus metadata
I20260810 04:11:35.077916 18271 master_runner.cc:315] Copying system tablet from 127.10.249.190:37879
I20260810 04:11:35.078536 18271 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: tablet copy: Beginning tablet copy session from remote peer at address 127.10.249.190:37879
I20260810 04:11:35.085366 18376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.078807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49160)
0810 04:11:35.078921 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.078930 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.078981 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.079131 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.079132 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.079309 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.079353 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.079355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.080242 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.080244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.081051 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.081054 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.081480 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.081481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.081530 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.082040 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.082045 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.082382 (+ 337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.084318 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.084319 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.084320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.084505 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.084731 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.084732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.084732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.084790 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.085077 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.085078 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.085119 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.085194 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.085282 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
I20260810 04:11:35.085397 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.078881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49160 (local address 127.10.249.190:37879)
0810 04:11:35.078927 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.078929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.078971 (+ 42us) server_negotiation.cc:407] Connection header received
0810 04:11:35.079050 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.079051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.079063 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.079119 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.079440 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.080140 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.081150 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.081396 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.081475 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.082468 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.082470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.082470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.082477 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.084211 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.084587 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.084588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.084588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.084654 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.084872 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.084873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.084874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.085005 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.085082 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.085240 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.085318 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:11:35.085966 17610 tablet_copy_service.cc:140] P 7112ca50e5804375bb5f054255f51bb5: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c92010f417d2440181036bddfc26021f ({username='oryx', principal='oryx/127.10.249.188@KRBTEST.COM'} at 127.0.0.1:49160)
I20260810 04:11:35.086024 17610 tablet_copy_service.cc:161] P 7112ca50e5804375bb5f054255f51bb5: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c92010f417d2440181036bddfc26021f at {username='oryx', principal='oryx/127.10.249.188@KRBTEST.COM'} at 127.0.0.1:49160: session id = c92010f417d2440181036bddfc26021f-00000000000000000000000000000000
I20260810 04:11:35.086534 17610 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 04:11:35.087031 18271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 04:11:35.088155 18271 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: tablet copy: Starting download of 0 data blocks...
I20260810 04:11:35.088335 18271 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: tablet copy: Starting download of 1 WAL segments...
I20260810 04:11:35.089236 18271 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 04:11:35.090227 17610 tablet_copy_service.cc:342] P 7112ca50e5804375bb5f054255f51bb5: Request end of tablet copy session c92010f417d2440181036bddfc26021f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.249.188@KRBTEST.COM'} at 127.0.0.1:49160
I20260810 04:11:35.090276 17610 tablet_copy_service.cc:433] P 7112ca50e5804375bb5f054255f51bb5: ending tablet copy session c92010f417d2440181036bddfc26021f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c92010f417d2440181036bddfc26021f
I20260810 04:11:35.094288 18271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:35.095530 18377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:35.095762 18271 server_base.cc:1034] running on GCE node
W20260810 04:11:35.097980 18378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:35.100734 18380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:35.100916 18271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:35.101078 18271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:35.102188 18271 hybrid_clock.cc:648] HybridClock initialized: now 1786335095102163 us; error 44 us; skew 500 ppm
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:35.103734 18271 init.cc:377] Logged in from keytab as oryx/127.10.249.188@KRBTEST.COM (short username oryx)
I20260810 04:11:35.104014 18271 webserver.cc:460] Webserver started at http://127.10.249.188:36811/ using document root <none> and password file <none>
I20260810 04:11:35.104149 18271 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:35.104192 18271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:35.104979 18271 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:35.105564 18387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.105666 18271 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.105700 18271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
uuid: "c92010f417d2440181036bddfc26021f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "9631ed92ebe6cb1281150ef076133c78"
server_key_iv: "cc7a5948ea9211a04769b33afbc93b20"
server_key_version: "encryptionkey@0"
I20260810 04:11:35.105752 18271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:35.130856 18271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:35.132444 18271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:35.135844 18271 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.188:41101
I20260810 04:11:35.135936 18441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.188:41101 every 8 connection(s)
I20260810 04:11:35.136181 18271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
I20260810 04:11:35.137017 18442 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:11:35.137570 18442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Bootstrap starting.
I20260810 04:11:35.140653 18442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:11:35.140913 18442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: Bootstrap complete.
I20260810 04:11:35.141126 18442 raft_consensus.cc:348] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:35.141219 18442 raft_consensus.cc:729] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c92010f417d2440181036bddfc26021f, State: Initialized, Role: LEARNER
I20260810 04:11:35.141263 18442 consensus_queue.cc:260] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:35.141438 18442 sys_catalog.cc:564] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:11:35.141441 18445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } } }
I20260810 04:11:35.141656 18445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f [sys.catalog]: This master's current role is: LEARNER
I20260810 04:11:35.143787 18456 catalog_manager.cc:1259] Loaded cluster ID: 0c991de091204b039be1cfc028999dac
I20260810 04:11:35.143867 18456 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: loading cluster ID for follower catalog manager: success
I20260810 04:11:35.144920 18456 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: acquiring CA information for follower catalog manager: success
I20260810 04:11:35.145255 18456 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c92010f417d2440181036bddfc26021f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 04:11:35.146456 18366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:35.146636 18366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:35.146684 18366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:35.147784 18366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:35.147840 18366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:35.147877 18366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:11:35.149412 18366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab
--principal=oryx/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:37739
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=44701
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:35.149669 18366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:35.149948 18366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:35.154373 18464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:35.154369 18461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:35.154448 18462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:35.154654 18366 server_base.cc:1034] running on GCE node
I20260810 04:11:35.154866 18366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:35.155072 18366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:35.156210 18366 hybrid_clock.cc:648] HybridClock initialized: now 1786335095156201 us; error 23 us; skew 500 ppm
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:35.158457 18366 init.cc:377] Logged in from keytab as oryx/127.10.249.129@KRBTEST.COM (short username oryx)
I20260810 04:11:35.158845 18366 webserver.cc:460] Webserver started at http://127.10.249.129:44701/ using document root <none> and password file <none>
I20260810 04:11:35.159049 18366 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:35.159143 18366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:35.160663 18366 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:11:35.161267 18471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.161413 18366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:11:35.161511 18366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "a6693750f3f24a48a0c611bd5337c6de"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "07603b34e86714abd99861569afb66f6"
server_key_iv: "904aed26d3bfbbdd48fa24c126c17f42"
server_key_version: "encryptionkey@0"
I20260810 04:11:35.161931 18366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:35.174022 18366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:35.176093 18366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:35.176244 18366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:35.176445 18366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:35.176730 18366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:35.176780 18366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.176812 18366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:35.176836 18366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.182417 18366 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:37739
I20260810 04:11:35.182483 18590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:37739 every 8 connection(s)
I20260810 04:11:35.182806 18366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:11:35.188854 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 18366
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:11:35.189013 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 17794
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.188@KRBTEST.COM
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.189@KRBTEST.COM
I20260810 04:11:35.193826 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.183443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:48561 (local address 127.10.249.189:44473)
0810 04:11:35.183489 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.183491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.183964 (+ 473us) server_negotiation.cc:407] Connection header received
0810 04:11:35.184454 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.184456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.184468 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.184528 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.185357 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.186065 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187511 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.187748 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187806 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.191361 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.191363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.191363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.191370 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.192515 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.192858 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.192859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.192859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.192915 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.193182 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.193183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.193184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.193301 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.193369 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.193631 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.193715 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:11:35.194243 18595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.183454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.10.249.129:48561)
0810 04:11:35.183842 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.183879 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.184356 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.184585 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.184589 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.185102 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.185225 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.185230 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.186150 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.186151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.187097 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.187099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.187813 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.187871 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.188170 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.188174 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.191274 (+ 3100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.192595 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.192601 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.192603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.192790 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.192972 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.192973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.192973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.193103 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.193372 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.193379 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.193506 (+ 127us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.193609 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.193765 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":35,"thread_start_us":95,"threads_started":1}
I20260810 04:11:35.196367 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.183554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:40627 (local address 127.10.249.188:41101)
0810 04:11:35.183706 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.183708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.184568 (+ 860us) server_negotiation.cc:407] Connection header received
0810 04:11:35.184653 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.184654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.184665 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.184744 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.185343 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.186007 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187034 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.187257 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187312 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.194069 (+ 6757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.194070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.194071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.194078 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.195374 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.195737 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.195738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.195738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.195781 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.195985 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.195986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.195986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.196068 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.196108 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.196257 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.196310 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":46,"threads_started":1}
I20260810 04:11:35.196624 18596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.183455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:41101 (local address 127.10.249.129:40627)
0810 04:11:35.184517 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.184527 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.184590 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.184750 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.184751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.185020 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.185224 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.185229 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.186103 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.186104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.186945 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.186947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.187324 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.187413 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.187863 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.187872 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.193970 (+ 6098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.195450 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.195450 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.195451 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.195663 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.195861 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.195862 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.195863 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.195928 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.196125 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.196126 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.196167 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.196246 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.196340 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1038,"mutex_wait_us":367,"thread_start_us":57,"threads_started":1}
I20260810 04:11:35.197149 18592 heartbeater.cc:347] Connected to a master server at 127.10.249.188:41101
I20260810 04:11:35.197260 18592 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.197448 18592 heartbeater.cc:511] Master 127.10.249.188:41101 requested a full tablet report, sending...
I20260810 04:11:35.198079 18406 ts_manager.cc:194] Registered new tserver with Master: a6693750f3f24a48a0c611bd5337c6de (127.10.249.129:37739)
I20260810 04:11:35.198678 18593 heartbeater.cc:347] Connected to a master server at 127.10.249.189:44473
I20260810 04:11:35.198731 18593 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.198805 18593 heartbeater.cc:511] Master 127.10.249.189:44473 requested a full tablet report, sending...
I20260810 04:11:35.199249 18214 ts_manager.cc:194] Registered new tserver with Master: a6693750f3f24a48a0c611bd5337c6de (127.10.249.129:37739)
I20260810 04:11:35.201333 18598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.183455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:41967)
0810 04:11:35.183843 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.183879 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.184371 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.184585 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.184589 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.185028 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.185225 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.185230 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.186157 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.186157 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.187097 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.187099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.187482 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187482 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.187536 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.188013 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.188017 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.198590 (+ 10573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.200381 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.200382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.200382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.200553 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.200767 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.200768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.200768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.200814 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.201106 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.201107 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.201134 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.201181 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.201254 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":104,"thread_start_us":82,"threads_started":1}
I20260810 04:11:35.201434 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.183742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:41967 (local address 127.10.249.190:37879)
0810 04:11:35.183789 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.183791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.183961 (+ 170us) server_negotiation.cc:407] Connection header received
0810 04:11:35.184455 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.184457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.184469 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.184520 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.185360 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.186056 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187185 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.187422 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.187467 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.198681 (+ 11214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.198682 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.198682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.198690 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.200303 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.200622 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.200623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.200624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.200707 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.200886 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.200887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.200887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.201051 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.201113 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.201204 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.201310 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:11:35.201718 18591 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37879
I20260810 04:11:35.201763 18591 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.201843 18591 heartbeater.cc:511] Master 127.10.249.190:37879 requested a full tablet report, sending...
I20260810 04:11:35.202138 17587 ts_manager.cc:194] Re-registered known tserver with Master: a6693750f3f24a48a0c611bd5337c6de (127.10.249.129:37739)
I20260810 04:11:35.202628 17587 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:41967
I20260810 04:11:35.203836 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:36441
--local_ip_for_outbound_sockets=127.10.249.130
--tserver_master_addrs=127.10.249.190:37879
--webserver_port=40379
--webserver_interface=127.10.249.130
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab
--principal=oryx/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:11:35.279404 18599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:35.279584 18599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:35.279606 18599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:35.280788 18599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:35.280829 18599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:35.280855 18599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:11:35.282295 18599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab
--principal=oryx/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:36441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=40379
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:35.282548 18599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:35.282754 18599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:35.287254 18604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:35.287292 18605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:35.287281 18607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:35.287505 18599 server_base.cc:1034] running on GCE node
I20260810 04:11:35.287700 18599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:35.287930 18599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:35.289255 18599 hybrid_clock.cc:648] HybridClock initialized: now 1786335095289246 us; error 32 us; skew 500 ppm
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:35.291651 18599 init.cc:377] Logged in from keytab as oryx/127.10.249.130@KRBTEST.COM (short username oryx)
I20260810 04:11:35.292062 18599 webserver.cc:460] Webserver started at http://127.10.249.130:40379/ using document root <none> and password file <none>
I20260810 04:11:35.292234 18599 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:35.292282 18599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:35.293466 18599 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:35.294075 18614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.294270 18599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:35.294378 18599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "f8c1018acecb4824b5a7a76a8f622c9d"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "ee695f41905198e2be2ff0e38e1d9d5b"
server_key_iv: "58eb20b6489e7c04ab65b5667ef27802"
server_key_version: "encryptionkey@0"
I20260810 04:11:35.294682 18599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:35.307775 18599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:35.309676 18599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:35.309881 18599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:35.310151 18599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:35.310494 18599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:35.310542 18599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.310572 18599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:35.310590 18599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.316469 18599 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:36441
I20260810 04:11:35.316543 18735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:36441 every 8 connection(s)
I20260810 04:11:35.316881 18599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:11:35.318819 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 18599
I20260810 04:11:35.318964 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 17934
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.188@KRBTEST.COM
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:11:35.328600 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.318113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:42419 (local address 127.10.249.188:41101)
0810 04:11:35.318158 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.318160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.318168 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:35.318525 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.318526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.318539 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.318568 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.319309 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.319975 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.321765 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.322173 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.322219 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.325401 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.325402 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.325402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.325410 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.326943 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.327528 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.327529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.327530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.327594 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.327971 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.327972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.327973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.328104 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.328195 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.328441 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.328521 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:11:35.328962 18742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.317920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:41101 (local address 127.10.249.130:42419)
0810 04:11:35.318021 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.318030 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.318448 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.318638 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.318639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.318978 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.319218 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.319223 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.320094 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.320095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.321625 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.321629 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.322317 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.322318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.322494 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.322985 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.323002 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.325293 (+ 2291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.327034 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.327043 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.327046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.327441 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.327702 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.327703 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.327703 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.327874 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.328191 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.328199 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.328321 (+ 122us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.328412 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.328548 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":1,"thread_start_us":64,"threads_started":1}
I20260810 04:11:35.329917 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.317598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:54053 (local address 127.10.249.190:37879)
0810 04:11:35.317650 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.317653 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.317873 (+ 220us) server_negotiation.cc:407] Connection header received
0810 04:11:35.318420 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.318422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.318435 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.318485 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.322695 (+ 4210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.323587 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.324551 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.324768 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.324823 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.327091 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.327092 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.327092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.327099 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.328866 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.329226 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.329227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.329227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.329285 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.329462 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.329463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.329463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.329563 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.329624 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.329761 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.329843 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:11:35.329962 18740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.317560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:54053)
0810 04:11:35.317740 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.317777 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.318322 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.318545 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.318548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.318957 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.322600 (+ 3643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.322603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.323679 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.323679 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.324460 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.324461 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.324880 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.324881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.324924 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.325304 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.325308 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.326988 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.328944 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.328945 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.328946 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.329146 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.329351 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.329352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.329352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.329403 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.329626 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.329627 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.329663 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.329728 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.329835 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":115,"threads_started":1}
I20260810 04:11:35.330338 18736 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37879
I20260810 04:11:35.330420 18736 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.330582 18736 heartbeater.cc:511] Master 127.10.249.190:37879 requested a full tablet report, sending...
I20260810 04:11:35.330818 18737 heartbeater.cc:347] Connected to a master server at 127.10.249.188:41101
I20260810 04:11:35.330856 18737 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.330919 18737 heartbeater.cc:511] Master 127.10.249.188:41101 requested a full tablet report, sending...
I20260810 04:11:35.330994 17587 ts_manager.cc:194] Re-registered known tserver with Master: f8c1018acecb4824b5a7a76a8f622c9d (127.10.249.130:36441)
I20260810 04:11:35.331318 17587 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:54053
I20260810 04:11:35.331651 18406 ts_manager.cc:194] Registered new tserver with Master: f8c1018acecb4824b5a7a76a8f622c9d (127.10.249.130:36441)
I20260810 04:11:35.335304 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:36843
--local_ip_for_outbound_sockets=127.10.249.131
--tserver_master_addrs=127.10.249.190:37879
--webserver_port=35459
--webserver_interface=127.10.249.131
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab
--principal=oryx/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:44003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.189@KRBTEST.COM
I20260810 04:11:35.339677 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.317555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:32965 (local address 127.10.249.189:44473)
0810 04:11:35.317606 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.317608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.317873 (+ 265us) server_negotiation.cc:407] Connection header received
0810 04:11:35.318446 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.318447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.318461 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.318509 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.334105 (+ 15596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.334825 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.335501 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.335669 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.335742 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.337258 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.337260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.337260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.337268 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.338615 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.338948 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.338949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.338949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.339005 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.339201 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.339202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.339202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.339307 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.339379 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.339502 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.339576 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:11:35.339689 18741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.317560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.10.249.130:32965)
0810 04:11:35.317741 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.317778 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.318342 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.318556 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.318557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.318975 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.334019 (+ 15044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.334021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.334894 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.334894 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.335399 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.335401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.335744 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.335744 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.335807 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.336141 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.336145 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.337173 (+ 1028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.338703 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.338704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.338704 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.338876 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.339071 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.339071 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.339072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.339125 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.339372 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.339373 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.339409 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.339475 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.339577 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":14955,"thread_start_us":105,"threads_started":1}
I20260810 04:11:35.340016 18738 heartbeater.cc:347] Connected to a master server at 127.10.249.189:44473
I20260810 04:11:35.340085 18738 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.340158 18738 heartbeater.cc:511] Master 127.10.249.189:44473 requested a full tablet report, sending...
I20260810 04:11:35.340487 18214 ts_manager.cc:194] Registered new tserver with Master: f8c1018acecb4824b5a7a76a8f622c9d (127.10.249.130:36441)
W20260810 04:11:35.414750 18743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:11:35.414937 18743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:11:35.414958 18743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:11:35.415983 18743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:11:35.416023 18743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:11:35.416069 18743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:11:35.417392 18743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab
--principal=oryx/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:36843
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=35459
--tserver_master_addrs=127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:11:35.417610 18743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:11:35.417856 18743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:11:35.422470 18748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:11:35.422461 18751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:35.422770 18743 server_base.cc:1034] running on GCE node
W20260810 04:11:35.422524 18749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:11:35.423808 18743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:11:35.424002 18743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:11:35.425137 18743 hybrid_clock.cc:648] HybridClock initialized: now 1786335095425132 us; error 33 us; skew 500 ppm
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:11:35.427537 18743 init.cc:377] Logged in from keytab as oryx/127.10.249.131@KRBTEST.COM (short username oryx)
I20260810 04:11:35.428010 18743 webserver.cc:460] Webserver started at http://127.10.249.131:35459/ using document root <none> and password file <none>
I20260810 04:11:35.428246 18743 fs_manager.cc:359] Metadata directory not provided
I20260810 04:11:35.428318 18743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:11:35.429728 18743 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:11:35.430433 18759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.430644 18743 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:11:35.430764 18743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "b800beb1686e4da491579e4f086e101f"
format_stamp: "Formatted at 2026-08-10 04:11:34 on dist-test-slave-0kls"
server_key: "80c9409d4adcddcf260fc20a89677975"
server_key_iv: "a1d3f2b8fde04b3198626860c26c04a1"
server_key_version: "encryptionkey@0"
I20260810 04:11:35.431115 18743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:11:35.443897 18743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:11:35.446036 18743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:11:35.446190 18743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:11:35.446399 18743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:11:35.446683 18743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:11:35.446734 18743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.446772 18743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:11:35.446797 18743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:11:35.452160 18743 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:36843
I20260810 04:11:35.452195 18877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:36843 every 8 connection(s)
I20260810 04:11:35.452502 18743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.189@KRBTEST.COM
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
Aug 10 04:11:35 dist-test-slave-0kls krb5kdc[17543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335095, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.188@KRBTEST.COM
I20260810 04:11:35.460536 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 18743
I20260810 04:11:35.463246 18262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.453557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:58215 (local address 127.10.249.189:44473)
0810 04:11:35.453628 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.453631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.453642 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:11:35.454267 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.454269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.454281 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.454310 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.455145 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.455804 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.456860 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.457109 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.457153 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.459147 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.459149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.459149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.459156 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.460948 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.462279 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.462280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.462280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.462334 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.462514 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.462514 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.462515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.462620 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.462679 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.463032 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.463157 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 04:11:35.463387 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.453208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:46541)
0810 04:11:35.453390 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.453439 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.454119 (+ 680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.454403 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.454404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.454844 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.455035 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.455040 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.455918 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.455919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.456614 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.456616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.457014 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.457014 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.457101 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.457571 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.457580 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.459428 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.461877 (+ 2449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.461878 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.461878 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.462080 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.462295 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.462296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.462296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.462420 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.462705 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.462713 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.462858 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.462958 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.463161 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":7,"spinlock_wait_cycles":6912,"thread_start_us":97,"threads_started":1}
I20260810 04:11:35.463538 18882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.453208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:44473 (local address 127.10.249.131:58215)
0810 04:11:35.453390 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.453439 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.454117 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.454391 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.454397 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.454872 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.455035 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.455040 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.455872 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.455872 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.456782 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.456784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.457176 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.457177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.457231 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.457722 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.457727 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.459065 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.461116 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.461121 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.461123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.461437 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.462398 (+ 961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.462398 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.462399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.462451 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.462705 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.462713 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.462858 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.462958 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.463449 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":391,"thread_start_us":90,"threads_started":1}
I20260810 04:11:35.463696 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.453221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:46541 (local address 127.10.249.190:37879)
0810 04:11:35.453271 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.453273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.453734 (+ 461us) server_negotiation.cc:407] Connection header received
0810 04:11:35.454268 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.454269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.454281 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.454310 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.455139 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.455825 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.456717 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.456945 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.457001 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.459524 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.459525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.459526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.459533 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.461764 (+ 2231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.462159 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.462161 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.462161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.462222 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.462489 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.462490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.462490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.462624 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.462679 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.463507 (+ 828us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.463593 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:11:35.464169 18880 heartbeater.cc:347] Connected to a master server at 127.10.249.189:44473
I20260810 04:11:35.464257 18880 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.464282 18878 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37879
I20260810 04:11:35.464337 18878 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.464448 18878 heartbeater.cc:511] Master 127.10.249.190:37879 requested a full tablet report, sending...
I20260810 04:11:35.464844 17587 ts_manager.cc:194] Re-registered known tserver with Master: b800beb1686e4da491579e4f086e101f (127.10.249.131:36843)
I20260810 04:11:35.465277 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.453711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:45373 (local address 127.10.249.188:41101)
0810 04:11:35.453756 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.453757 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.453765 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:35.454242 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.454243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.454267 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.454313 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.455122 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.455597 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.457196 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.457427 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.457484 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.460508 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.460510 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.460510 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.460518 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.462191 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.464510 (+ 2319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.464511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.464512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.464587 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.464783 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.464783 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.464784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.464911 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.464948 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.465125 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.465196 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:11:35.465307 17587 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:46541
I20260810 04:11:35.464450 18880 heartbeater.cc:511] Master 127.10.249.189:44473 requested a full tablet report, sending...
I20260810 04:11:35.465569 18884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.453517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:41101 (local address 127.10.249.131:45373)
0810 04:11:35.453714 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.453724 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.454116 (+ 392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.454637 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.454638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.454881 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:11:35.455034 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.455038 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.455703 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.455703 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.456782 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.456784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.457490 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.457491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.457564 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.457919 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:11:35.457923 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:11:35.460397 (+ 2474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:11:35.464054 (+ 3657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.464055 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.464056 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.464426 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.464660 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:11:35.464661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:11:35.464661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:11:35.464717 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:11:35.464987 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:11:35.464987 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:11:35.465020 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.465385 (+ 365us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.465478 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":42,"thread_start_us":72,"threads_started":1}
I20260810 04:11:35.465891 18214 ts_manager.cc:194] Registered new tserver with Master: b800beb1686e4da491579e4f086e101f (127.10.249.131:36843)
I20260810 04:11:35.466655 18879 heartbeater.cc:347] Connected to a master server at 127.10.249.188:41101
I20260810 04:11:35.466703 18879 heartbeater.cc:464] Registering TS with master...
I20260810 04:11:35.466778 18879 heartbeater.cc:511] Master 127.10.249.188:41101 requested a full tablet report, sending...
I20260810 04:11:35.467254 18406 ts_manager.cc:194] Registered new tserver with Master: b800beb1686e4da491579e4f086e101f (127.10.249.131:36843)
I20260810 04:11:35.470793 18893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.462314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49170 (local address 127.10.249.190:37879)
0810 04:11:35.463021 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.463023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.463226 (+ 203us) server_negotiation.cc:407] Connection header received
0810 04:11:35.463248 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.463249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.463263 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.463471 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.464482 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.465293 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.466324 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.466623 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.466675 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.468061 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.468062 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.468062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.468069 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.469606 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.470009 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.470010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.470010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.470070 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.470284 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.470285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.470285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.470395 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.470494 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.470610 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.470682 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":77,"threads_started":1}
I20260810 04:11:35.472637 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.461961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40220 (local address 127.10.249.188:41101)
0810 04:11:35.462218 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.462220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.462609 (+ 389us) server_negotiation.cc:407] Connection header received
0810 04:11:35.462632 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.462633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.462645 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.462771 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.466290 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.467032 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.467996 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.468286 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.468348 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.469707 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.469708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.469708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.469715 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.471328 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.471763 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.471764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.471764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.471974 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.472168 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.472169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.472169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.472295 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.472392 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.472478 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.472547 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":60,"threads_started":1}
I20260810 04:11:35.473176 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.461958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50094 (local address 127.10.249.189:44473)
0810 04:11:35.462621 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.462623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.462630 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:11:35.462659 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.462659 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.462671 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.462771 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.466084 (+ 3313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.466774 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.467794 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.468114 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.468195 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.469757 (+ 1562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.469758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.469759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.469765 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.471764 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.472112 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.472113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.472114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.472173 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.472321 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.472322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.472322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.472437 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.472518 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.472962 (+ 444us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.473062 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":57,"threads_started":1}
I20260810 04:11:35.472251 17587 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:11:35.474428 17587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:11:35.481729 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.478046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37739 (local address 127.0.0.1:53218)
0810 04:11:35.478173 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.478183 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.478217 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.478898 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.478899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.478901 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:35.478938 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.478939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.479827 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.479828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.480627 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.480629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.481501 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.481502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.481551 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.481555 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.481613 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.481653 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260810 04:11:35.481751 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.478367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53218 (local address 127.10.249.129:37739)
0810 04:11:35.478633 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.478637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.478649 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:11:35.478688 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.478691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.478707 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.478905 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:35.478993 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.479719 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.480724 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.481428 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.481510 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.481566 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.481623 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.481664 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":90,"threads_started":1}
I20260810 04:11:35.482578 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.478150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47952 (local address 127.10.249.131:36843)
0810 04:11:35.479076 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.479093 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.479101 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:11:35.479131 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.479133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.479155 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.479221 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:35.479341 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.480350 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.481377 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.482087 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.482170 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.482260 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.482282 (+ 22us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.482316 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":894,"thread_start_us":95,"threads_started":1}
I20260810 04:11:35.482565 18521 tablet_service.cc:1467] Processing CreateTablet for tablet 4c0645fda0174a5f8326bfe620037369 (DEFAULT_TABLE table=test-table [id=7c09009fc2824ec9a1fa3cc0abc5bebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:35.482822 18901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.478072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:36843 (local address 127.0.0.1:47952)
0810 04:11:35.478661 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.478669 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.478832 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.479236 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.479236 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.479239 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:35.479281 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.479282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.480458 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.480459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.481295 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.481298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.482158 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.482159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.482214 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.482217 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.482256 (+ 39us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.482567 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":83,"threads_started":1}
I20260810 04:11:35.482878 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.478245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:36441 (local address 127.0.0.1:43202)
0810 04:11:35.478905 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.478912 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.478976 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.479162 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.479162 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.479164 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:35.479209 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.479210 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.480452 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.480454 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.481492 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.481495 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.482388 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.482389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.482443 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.482447 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.482474 (+ 27us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.482531 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":63,"threads_started":1}
I20260810 04:11:35.482956 18521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c0645fda0174a5f8326bfe620037369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:35.483016 18903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.478357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43202 (local address 127.10.249.130:36441)
0810 04:11:35.478627 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.478632 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.478979 (+ 347us) server_negotiation.cc:407] Connection header received
0810 04:11:35.479042 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.479044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.479060 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.479275 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:35.479329 (+ 54us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.480342 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.481574 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.482292 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.482793 (+ 501us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.482853 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.482883 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.482926 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":168,"threads_started":1}
I20260810 04:11:35.483613 18808 tablet_service.cc:1467] Processing CreateTablet for tablet 4c0645fda0174a5f8326bfe620037369 (DEFAULT_TABLE table=test-table [id=7c09009fc2824ec9a1fa3cc0abc5bebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:35.483939 18808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c0645fda0174a5f8326bfe620037369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:35.486158 18904 tablet_bootstrap.cc:492] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: Bootstrap starting.
I20260810 04:11:35.486526 18905 tablet_bootstrap.cc:492] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: Bootstrap starting.
I20260810 04:11:35.486824 18904 tablet_bootstrap.cc:654] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:35.486756 18666 tablet_service.cc:1467] Processing CreateTablet for tablet 4c0645fda0174a5f8326bfe620037369 (DEFAULT_TABLE table=test-table [id=7c09009fc2824ec9a1fa3cc0abc5bebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:11:35.487058 18666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c0645fda0174a5f8326bfe620037369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:11:35.487124 18905 tablet_bootstrap.cc:654] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:35.487118 18904 log.cc:824] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:35.487396 18905 log.cc:824] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:35.487795 18904 tablet_bootstrap.cc:492] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: No bootstrap required, opened a new log
I20260810 04:11:35.487856 18904 ts_tablet_manager.cc:1397] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:35.488061 18905 tablet_bootstrap.cc:492] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: No bootstrap required, opened a new log
I20260810 04:11:35.488137 18905 ts_tablet_manager.cc:1397] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:11:35.489722 18904 raft_consensus.cc:348] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.489920 18904 raft_consensus.cc:374] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:35.489965 18904 raft_consensus.cc:729] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6693750f3f24a48a0c611bd5337c6de, State: Initialized, Role: FOLLOWER
I20260810 04:11:35.490072 18904 consensus_queue.cc:260] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.490025 18905 raft_consensus.cc:348] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.490182 18905 raft_consensus.cc:374] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:35.490223 18905 raft_consensus.cc:729] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b800beb1686e4da491579e4f086e101f, State: Initialized, Role: FOLLOWER
I20260810 04:11:35.490382 18904 ts_tablet_manager.cc:1428] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:11:35.490530 18591 heartbeater.cc:503] Master 127.10.249.190:37879 was elected leader, sending a full tablet report...
I20260810 04:11:35.490478 18905 consensus_queue.cc:260] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.490834 18905 ts_tablet_manager.cc:1428] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:11:35.490936 18878 heartbeater.cc:503] Master 127.10.249.190:37879 was elected leader, sending a full tablet report...
I20260810 04:11:35.491737 18908 tablet_bootstrap.cc:492] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Bootstrap starting.
I20260810 04:11:35.492465 18908 tablet_bootstrap.cc:654] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Neither blocks nor log segments found. Creating new log.
I20260810 04:11:35.492818 18908 log.cc:824] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:11:35.493516 18908 tablet_bootstrap.cc:492] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: No bootstrap required, opened a new log
I20260810 04:11:35.493585 18908 ts_tablet_manager.cc:1397] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 04:11:35.494896 18908 raft_consensus.cc:348] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.495002 18908 raft_consensus.cc:374] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:11:35.495023 18908 raft_consensus.cc:729] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8c1018acecb4824b5a7a76a8f622c9d, State: Initialized, Role: FOLLOWER
I20260810 04:11:35.495164 18908 consensus_queue.cc:260] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.495407 18736 heartbeater.cc:503] Master 127.10.249.190:37879 was elected leader, sending a full tablet report...
I20260810 04:11:35.495604 18908 ts_tablet_manager.cc:1428] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:11:35.547785 18910 raft_consensus.cc:482] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:11:35.547907 18910 raft_consensus.cc:504] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.548413 18910 leader_election.cc:288] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6693750f3f24a48a0c611bd5337c6de (127.10.249.129:37739), f8c1018acecb4824b5a7a76a8f622c9d (127.10.249.130:36441)
I20260810 04:11:35.551412 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.548685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:54271 (local address 127.10.249.129:37739)
0810 04:11:35.548750 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.548752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.548904 (+ 152us) server_negotiation.cc:407] Connection header received
0810 04:11:35.548934 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.548935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.548946 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.549005 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:35.549191 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.549692 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.550696 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.551091 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.551173 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.551183 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.551308 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.551349 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:11:35.551435 18903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.548724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:52047 (local address 127.10.249.130:36441)
0810 04:11:35.548784 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.548786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.548796 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:11:35.548826 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.548827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.548837 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.548896 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:11:35.549111 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.549660 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.550724 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.551090 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.551174 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.551183 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.551332 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.551374 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:11:35.551443 18882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.548593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37739 (local address 127.10.249.131:54271)
0810 04:11:35.548803 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.548815 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.548873 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.549013 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.549014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.549015 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:35.549104 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.549105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.549776 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.549778 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.550589 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.550592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.551172 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.551173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.551236 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.551240 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.551285 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.551337 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":167}
I20260810 04:11:35.551446 18884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.548584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:36441 (local address 127.10.249.131:52047)
0810 04:11:35.548623 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:35.548634 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:11:35.548707 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:11:35.548925 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:11:35.548926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:11:35.548928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:11:35.549012 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.549014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.549745 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.549746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.550586 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:11:35.550589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.551176 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.551176 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:11:35.551253 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.551255 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:11:35.551316 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 04:11:35.551348 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260810 04:11:35.551760 18543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c0645fda0174a5f8326bfe620037369" candidate_uuid: "b800beb1686e4da491579e4f086e101f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6693750f3f24a48a0c611bd5337c6de" is_pre_election: true
I20260810 04:11:35.551901 18543 raft_consensus.cc:2454] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b800beb1686e4da491579e4f086e101f in term 0.
I20260810 04:11:35.552098 18763 leader_election.cc:302] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6693750f3f24a48a0c611bd5337c6de, b800beb1686e4da491579e4f086e101f; no voters:
I20260810 04:11:35.552095 18687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c0645fda0174a5f8326bfe620037369" candidate_uuid: "b800beb1686e4da491579e4f086e101f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" is_pre_election: true
I20260810 04:11:35.552228 18687 raft_consensus.cc:2454] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b800beb1686e4da491579e4f086e101f in term 0.
I20260810 04:11:35.552261 18910 raft_consensus.cc:2781] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:11:35.552416 18910 raft_consensus.cc:482] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:11:35.552456 18910 raft_consensus.cc:3037] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:35.553144 18910 raft_consensus.cc:504] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.553292 18910 leader_election.cc:288] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [CANDIDATE]: Term 1 election: Requested vote from peers a6693750f3f24a48a0c611bd5337c6de (127.10.249.129:37739), f8c1018acecb4824b5a7a76a8f622c9d (127.10.249.130:36441)
I20260810 04:11:35.553457 18687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c0645fda0174a5f8326bfe620037369" candidate_uuid: "b800beb1686e4da491579e4f086e101f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8c1018acecb4824b5a7a76a8f622c9d"
I20260810 04:11:35.553536 18687 raft_consensus.cc:3037] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:35.553862 18543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c0645fda0174a5f8326bfe620037369" candidate_uuid: "b800beb1686e4da491579e4f086e101f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6693750f3f24a48a0c611bd5337c6de"
I20260810 04:11:35.553948 18543 raft_consensus.cc:3037] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:11:35.554713 18687 raft_consensus.cc:2454] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b800beb1686e4da491579e4f086e101f in term 1.
I20260810 04:11:35.554738 18543 raft_consensus.cc:2454] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b800beb1686e4da491579e4f086e101f in term 1.
I20260810 04:11:35.554873 18763 leader_election.cc:302] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6693750f3f24a48a0c611bd5337c6de, b800beb1686e4da491579e4f086e101f; no voters:
I20260810 04:11:35.554949 18910 raft_consensus.cc:2781] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:11:35.555107 18910 raft_consensus.cc:686] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 1 LEADER]: Becoming Leader. State: Replica: b800beb1686e4da491579e4f086e101f, State: Running, Role: LEADER
I20260810 04:11:35.555210 18910 consensus_queue.cc:237] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } }
I20260810 04:11:35.556000 17587 catalog_manager.cc:5495] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f reported cstate change: term changed from 0 to 1, leader changed from <none> to b800beb1686e4da491579e4f086e101f (127.10.249.131). New cstate: current_term: 1 leader_uuid: "b800beb1686e4da491579e4f086e101f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b800beb1686e4da491579e4f086e101f" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 } health_report { overall_health: UNKNOWN } } }
W20260810 04:11:35.568590 18739 tablet.cc:2369] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:11:35.572242 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.570300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47954 (local address 127.10.249.131:36843)
0810 04:11:35.570355 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.570357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.570364 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:11:35.570431 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.570432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.570447 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.570508 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:11:35.570613 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.571029 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.571647 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.571806 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.571850 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.571964 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:11:35.572048 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:11:35.572101 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.572128 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.572143 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:11:35.573954 18543 raft_consensus.cc:1261] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 1 FOLLOWER]: Refusing update from remote peer b800beb1686e4da491579e4f086e101f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:35.573954 18687 raft_consensus.cc:1261] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 1 FOLLOWER]: Refusing update from remote peer b800beb1686e4da491579e4f086e101f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:11:35.574364 18914 consensus_queue.cc:1035] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8c1018acecb4824b5a7a76a8f622c9d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:35.574498 18910 consensus_queue.cc:1035] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6693750f3f24a48a0c611bd5337c6de" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:11:35.576913 18917 mvcc.cc:205] Tried to move back new op lower bound from 7316828551468281856 to 7316828551394926592. Current Snapshot: MvccSnapshot[applied={T|T < 7316828551468281856}]
I20260810 04:11:35.578012 18919 mvcc.cc:205] Tried to move back new op lower bound from 7316828551468281856 to 7316828551394926592. Current Snapshot: MvccSnapshot[applied={T|T < 7316828551468281856}]
I20260810 04:11:35.579841 18918 mvcc.cc:205] Tried to move back new op lower bound from 7316828551468281856 to 7316828551394926592. Current Snapshot: MvccSnapshot[applied={T|T < 7316828551468281856 or (T in {7316828551468281856})}]
I20260810 04:11:35.579861 17587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:35.579947 17587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:11:35.581208 17587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7112ca50e5804375bb5f054255f51bb5: Sending DeleteTablet for 3 replicas of tablet 4c0645fda0174a5f8326bfe620037369
I20260810 04:11:35.581475 18808 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c0645fda0174a5f8326bfe620037369 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:35 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:47952
I20260810 04:11:35.581511 18521 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c0645fda0174a5f8326bfe620037369 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:35 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:53218
I20260810 04:11:35.581708 18666 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c0645fda0174a5f8326bfe620037369 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:11:35 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:43202
I20260810 04:11:35.582249 18927 tablet_replica.cc:330] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: stopping tablet replica
I20260810 04:11:35.582355 18927 raft_consensus.cc:2229] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:35.582442 18927 raft_consensus.cc:2258] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:35.582448 18928 tablet_replica.cc:330] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: stopping tablet replica
I20260810 04:11:35.582479 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 17556
I20260810 04:11:35.582528 18928 raft_consensus.cc:2229] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:11:35.582602 18928 raft_consensus.cc:2258] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:35.585244 18928 ts_tablet_manager.cc:1905] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:35.586093 18927 ts_tablet_manager.cc:1905] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:35.587832 18927 ts_tablet_manager.cc:1918] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:35.587903 18927 log.cc:1196] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/4c0645fda0174a5f8326bfe620037369
I20260810 04:11:35.588194 18927 ts_tablet_manager.cc:1939] T 4c0645fda0174a5f8326bfe620037369 P a6693750f3f24a48a0c611bd5337c6de: Deleting consensus metadata
I20260810 04:11:35.588593 18928 ts_tablet_manager.cc:1918] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:35.588662 18928 log.cc:1196] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/4c0645fda0174a5f8326bfe620037369
I20260810 04:11:35.588857 18928 ts_tablet_manager.cc:1939] T 4c0645fda0174a5f8326bfe620037369 P f8c1018acecb4824b5a7a76a8f622c9d: Deleting consensus metadata
I20260810 04:11:35.589020 18926 tablet_replica.cc:330] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: stopping tablet replica
I20260810 04:11:35.589123 18926 raft_consensus.cc:2229] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:11:35.589211 18926 raft_consensus.cc:2258] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:11:35.589553 18926 ts_tablet_manager.cc:1905] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:11:35.591410 18926 ts_tablet_manager.cc:1918] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:11:35.591487 18926 log.cc:1196] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/4c0645fda0174a5f8326bfe620037369
I20260810 04:11:35.591755 18926 ts_tablet_manager.cc:1939] T 4c0645fda0174a5f8326bfe620037369 P b800beb1686e4da491579e4f086e101f: Deleting consensus metadata
W20260810 04:11:35.593111 18763 connection.cc:535] server connection from 127.0.0.1:47952 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 04:11:35.593132 18618 connection.cc:535] server connection from 127.0.0.1:43202 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 04:11:35.593427 18475 connection.cc:535] server connection from 127.0.0.1:53218 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 04:11:35.597887 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.582029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40222 (local address 127.10.249.188:41101)
0810 04:11:35.582138 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.582140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.589974 (+ 7834us) server_negotiation.cc:407] Connection header received
0810 04:11:35.590083 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.590084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.590098 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.590130 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.590951 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.591674 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.592594 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.592806 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.592902 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.594751 (+ 1849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.594753 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.594753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.594762 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.596314 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.596798 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.596799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.596800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.596855 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.597055 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.597056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.597056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.597201 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.597284 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.597689 (+ 405us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.597763 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260810 04:11:35.603132 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.595584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40236 (local address 127.10.249.188:41101)
0810 04:11:35.595619 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.595621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.595842 (+ 221us) server_negotiation.cc:407] Connection header received
0810 04:11:35.595951 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.595952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.595964 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.596014 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.596772 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.597501 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.598629 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.598811 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.598892 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.600207 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.600209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.600209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.600217 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.601923 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.602314 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.602316 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.602316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.602372 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.602589 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.602590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.602591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.602704 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.602767 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.602945 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.603010 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:11:35.603333 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:35.595417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50106 (local address 127.10.249.189:44473)
0810 04:11:35.595463 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:11:35.595465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:11:35.595930 (+ 465us) server_negotiation.cc:407] Connection header received
0810 04:11:35.596031 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:11:35.596033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:11:35.596047 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:11:35.596080 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:11:35.596917 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.597577 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.598608 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:11:35.598894 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:11:35.598954 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:11:35.600431 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:11:35.600432 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:11:35.600433 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:11:35.600441 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:11:35.602074 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.602489 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.602490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.602490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.602545 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:11:35.602763 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:11:35.602764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:11:35.602764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:11:35.602877 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:11:35.602980 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 04:11:35.603129 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 04:11:35.603211 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:11:36.578761 18937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:36.578480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:41841)
0810 04:11:36.578616 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:36.578711 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
W20260810 04:11:36.579196 18878 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:37879 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:36.579424 18938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:36.579195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:37469)
0810 04:11:36.579296 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:36.579378 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":49,"threads_started":1}
W20260810 04:11:36.579624 18591 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:37879 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:36.580660 18939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:36.580494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:58615)
0810 04:11:36.580578 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:36.580628 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":43,"threads_started":1}
W20260810 04:11:36.580873 18736 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:37879 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:37.081596 18941 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7112ca50e5804375bb5f054255f51bb5)
I20260810 04:11:37.081749 18941 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:37.082034 18941 leader_election.cc:288] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879)
I20260810 04:11:37.082326 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:37.082156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49630)
0810 04:11:37.082243 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:37.082292 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":52,"threads_started":1}
W20260810 04:11:37.082466 18197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:37.082893 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:37.082785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49632)
0810 04:11:37.082834 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:37.082875 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 04:11:37.082996 18197 leader_election.cc:334] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879): Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:37.083067 18197 leader_election.cc:302] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cd42d8f6ef7b434f89e65b3933acc4b2; no voters: 7112ca50e5804375bb5f054255f51bb5
I20260810 04:11:37.083197 18941 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:11:37.579927 18944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:37.579572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:53405)
0810 04:11:37.579804 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:37.579859 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":67,"threads_started":1}
I20260810 04:11:37.580238 18945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:37.579939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:37991)
0810 04:11:37.580132 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:37.580186 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":62,"threads_started":1}
I20260810 04:11:37.581311 18946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:37.581159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:58297)
0810 04:11:37.581251 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:37.581277 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":46,"threads_started":1}
I20260810 04:11:38.580806 18947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:38.580528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:60931)
0810 04:11:38.580703 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:38.580746 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":70,"threads_started":1}
I20260810 04:11:38.580847 18948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:38.580676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:60255)
0810 04:11:38.580769 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:38.580807 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":51,"threads_started":1}
I20260810 04:11:38.581905 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:38.581703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:58525)
0810 04:11:38.581835 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:38.581875 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":52,"threads_started":1}
I20260810 04:11:39.286468 18950 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7112ca50e5804375bb5f054255f51bb5)
I20260810 04:11:39.286563 18950 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:39.286686 18950 leader_election.cc:288] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879)
I20260810 04:11:39.287051 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:39.286872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49920)
0810 04:11:39.286974 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:39.287016 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":53,"threads_started":1}
I20260810 04:11:39.287461 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:39.287371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:49922)
0810 04:11:39.287415 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:39.287444 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 04:11:39.287532 18197 leader_election.cc:334] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879): Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:39.287592 18197 leader_election.cc:302] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cd42d8f6ef7b434f89e65b3933acc4b2; no voters: 7112ca50e5804375bb5f054255f51bb5
I20260810 04:11:39.287659 18950 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:11:39.581478 18954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:39.581238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:52085)
0810 04:11:39.581371 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:39.581411 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
I20260810 04:11:39.581504 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:39.581291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:46713)
0810 04:11:39.581404 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:39.581440 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":77,"threads_started":1}
I20260810 04:11:39.582427 18956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:39.582284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:60835)
0810 04:11:39.582368 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:39.582397 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70,"thread_start_us":50,"threads_started":1}
I20260810 04:11:40.582195 18957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:40.581952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:49923)
0810 04:11:40.582077 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:40.582144 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":75,"threads_started":1}
I20260810 04:11:40.582195 18958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:40.581963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:33815)
0810 04:11:40.582090 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:40.582122 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
I20260810 04:11:40.582973 18959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:40.582782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:56499)
0810 04:11:40.582870 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:40.582930 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":42,"threads_started":1}
I20260810 04:11:40.870595 18960 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7112ca50e5804375bb5f054255f51bb5)
I20260810 04:11:40.870692 18960 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:40.870913 18960 leader_election.cc:288] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879)
I20260810 04:11:40.871289 18961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:40.871089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:56994)
0810 04:11:40.871216 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:40.871252 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":69,"threads_started":1}
I20260810 04:11:40.871701 18961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:40.871595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:57002)
0810 04:11:40.871647 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:40.871674 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:11:40.871773 18197 leader_election.cc:334] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879): Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:40.871820 18197 leader_election.cc:302] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cd42d8f6ef7b434f89e65b3933acc4b2; no voters: 7112ca50e5804375bb5f054255f51bb5
I20260810 04:11:40.871886 18960 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:11:41.582903 18963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:41.582612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:38541)
0810 04:11:41.582809 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:41.582851 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":81,"threads_started":1}
I20260810 04:11:41.582938 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:41.582739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:54677)
0810 04:11:41.582856 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:41.582891 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":54,"threads_started":1}
I20260810 04:11:41.583545 18965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:41.583348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:40381)
0810 04:11:41.583463 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:41.583495 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":67,"threads_started":1}
I20260810 04:11:42.583629 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:42.583318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:35539)
0810 04:11:42.583502 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:42.583566 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":64,"threads_started":1}
I20260810 04:11:42.583721 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:42.583420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:38243)
0810 04:11:42.583626 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:42.583669 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":53,"threads_started":1}
I20260810 04:11:42.584116 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:42.583981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:33705)
0810 04:11:42.584061 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:42.584084 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69,"thread_start_us":38,"threads_started":1}
I20260810 04:11:43.584391 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:43.584154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:34043)
0810 04:11:43.584290 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:43.584331 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260810 04:11:43.584525 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:43.584345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:37683)
0810 04:11:43.584451 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:43.584481 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":45,"threads_started":1}
I20260810 04:11:43.584762 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:43.584478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:52203)
0810 04:11:43.584613 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:43.584650 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":58,"threads_started":1}
I20260810 04:11:44.585152 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:44.584941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:38087)
0810 04:11:44.585046 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:44.585085 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":59,"threads_started":1}
I20260810 04:11:44.585350 18973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:44.584927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:36901)
0810 04:11:44.585278 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:44.585312 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":72,"threads_started":1}
I20260810 04:11:44.585358 18975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:44.585164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:37265)
0810 04:11:44.585299 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:44.585326 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":52,"threads_started":1}
I20260810 04:11:45.039541 18976 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7112ca50e5804375bb5f054255f51bb5)
I20260810 04:11:45.039639 18976 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:45.039788 18976 leader_election.cc:288] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879)
I20260810 04:11:45.040134 18977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:45.039953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:57360)
0810 04:11:45.040055 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:45.040098 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":62,"threads_started":1}
W20260810 04:11:45.040220 18197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260810 04:11:45.040565 18977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:45.040471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:57370)
0810 04:11:45.040521 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:45.040548 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:11:45.040647 18197 leader_election.cc:334] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879): Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:45.040706 18197 leader_election.cc:302] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cd42d8f6ef7b434f89e65b3933acc4b2; no voters: 7112ca50e5804375bb5f054255f51bb5
I20260810 04:11:45.040792 18976 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:11:45.585878 18980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:45.585704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:35777)
0810 04:11:45.585815 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:45.585840 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":43,"threads_started":1}
I20260810 04:11:45.585878 18979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:45.585618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:40541)
0810 04:11:45.585767 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:45.585825 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":74,"threads_started":1}
I20260810 04:11:45.586072 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:45.585825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:37781)
0810 04:11:45.585983 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:45.586022 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":56,"threads_started":1}
I20260810 04:11:46.586701 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:46.586301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:50541)
0810 04:11:46.586581 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:46.586630 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":169,"threads_started":1}
I20260810 04:11:46.586782 18985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:46.586613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:48855)
0810 04:11:46.586708 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:46.586741 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":46,"threads_started":1}
I20260810 04:11:46.586758 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:46.586320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:40819)
0810 04:11:46.586668 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:46.586708 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":88,"threads_started":1}
I20260810 04:11:47.587409 18986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:47.587122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:41605)
0810 04:11:47.587307 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:47.587350 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":75,"threads_started":1}
I20260810 04:11:47.587478 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:47.587284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:37445)
0810 04:11:47.587399 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:47.587432 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":47,"threads_started":1}
I20260810 04:11:47.587561 18988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:47.587347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:54431)
0810 04:11:47.587448 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:47.587478 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":55,"threads_started":1}
I20260810 04:11:48.588202 18990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:48.587978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:48251)
0810 04:11:48.588108 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:48.588159 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":56,"threads_started":1}
I20260810 04:11:48.588241 18991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:48.588006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:33153)
0810 04:11:48.588168 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:48.588200 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":62,"threads_started":1}
I20260810 04:11:48.588203 18989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:48.587875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:52033)
0810 04:11:48.588060 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:48.588119 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":71,"threads_started":1}
I20260810 04:11:49.588937 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:49.588671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:34357)
0810 04:11:49.588833 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:49.588876 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260810 04:11:49.589102 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:49.588895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:38387)
0810 04:11:49.589003 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:49.589034 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260810 04:11:49.589286 18994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:49.588949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:48967)
0810 04:11:49.589191 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:49.589226 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":47,"threads_started":1}
I20260810 04:11:50.003818 18995 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7112ca50e5804375bb5f054255f51bb5)
I20260810 04:11:50.003947 18995 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:50.004134 18995 leader_election.cc:288] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879)
I20260810 04:11:50.004648 18996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:50.004391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:57662)
0810 04:11:50.004505 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:50.004583 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":64,"threads_started":1}
I20260810 04:11:50.005158 18996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:50.005035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:57664)
0810 04:11:50.005085 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:50.005118 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 04:11:50.005323 18197 leader_election.cc:334] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879): Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:50.005389 18197 leader_election.cc:302] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cd42d8f6ef7b434f89e65b3933acc4b2; no voters: 7112ca50e5804375bb5f054255f51bb5
I20260810 04:11:50.005483 18995 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:11:50.589913 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:50.589589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:51613)
0810 04:11:50.589812 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:50.589856 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":91,"threads_started":1}
I20260810 04:11:50.589969 19000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:50.589812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:53097)
0810 04:11:50.589909 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:50.589934 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":46,"threads_started":1}
I20260810 04:11:50.589969 18999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:50.589714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:42697)
0810 04:11:50.589886 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:50.589926 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":56,"threads_started":1}
I20260810 04:11:51.590816 19001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:51.590424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:41665)
0810 04:11:51.590713 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:51.590757 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":65,"threads_started":1}
I20260810 04:11:51.590862 19003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:51.590630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:50737)
0810 04:11:51.590770 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:51.590808 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260810 04:11:51.590871 19002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:51.590598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:46899)
0810 04:11:51.590803 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:51.590830 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":85,"threads_started":1}
I20260810 04:11:52.591622 19005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:52.591385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:54801)
0810 04:11:52.591522 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:52.591564 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260810 04:11:52.591727 19007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:52.591386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:53085)
0810 04:11:52.591640 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:52.591678 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":65,"threads_started":1}
I20260810 04:11:52.591768 19006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:52.591386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:33785)
0810 04:11:52.591693 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:52.591727 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":68,"threads_started":1}
I20260810 04:11:53.592399 19008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:53.592179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:54411)
0810 04:11:53.592313 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:53.592344 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":59,"threads_started":1}
I20260810 04:11:53.592573 19009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:53.592195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:43539)
0810 04:11:53.592496 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:53.592532 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":59,"threads_started":1}
I20260810 04:11:53.592734 19010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:53.592247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:41051)
0810 04:11:53.592664 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:53.592697 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":51,"threads_started":1}
I20260810 04:11:54.593410 19013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:54.593210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:51975)
0810 04:11:54.593310 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:54.593355 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":45,"threads_started":1}
I20260810 04:11:54.593410 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:54.593113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:59781)
0810 04:11:54.593310 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:54.593357 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260810 04:11:54.593619 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:54.593111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:50107)
0810 04:11:54.593547 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:54.593580 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":63,"threads_started":1}
I20260810 04:11:55.594369 19014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:55.594059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:44143)
0810 04:11:55.594264 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:55.594313 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":75,"threads_started":1}
I20260810 04:11:55.594373 19015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:55.594126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:44331)
0810 04:11:55.594306 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:55.594334 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
I20260810 04:11:55.594496 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:55.594262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:50051)
0810 04:11:55.594381 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:55.594437 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":49,"threads_started":1}
I20260810 04:11:56.595080 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:56.594827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:36693)
0810 04:11:56.594974 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:56.595017 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":66,"threads_started":1}
I20260810 04:11:56.595175 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:56.594989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:59289)
0810 04:11:56.595090 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:56.595125 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":48,"threads_started":1}
I20260810 04:11:56.595196 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:56.594976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:45081)
0810 04:11:56.595120 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:56.595157 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":55,"threads_started":1}
I20260810 04:11:57.595875 19021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:57.595563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:38643)
0810 04:11:57.595759 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:57.595816 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":66,"threads_started":1}
I20260810 04:11:57.595916 19022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:57.595563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:40775)
0810 04:11:57.595824 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:57.595867 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":68,"threads_started":1}
I20260810 04:11:57.596012 19023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:57.595828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:60131)
0810 04:11:57.595943 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:57.595977 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":65,"threads_started":1}
I20260810 04:11:58.142746 19024 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7112ca50e5804375bb5f054255f51bb5)
I20260810 04:11:58.142843 19024 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:11:58.143061 19024 leader_election.cc:288] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879)
I20260810 04:11:58.143388 19025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:58.143217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:36488)
0810 04:11:58.143322 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:58.143355 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":54,"threads_started":1}
W20260810 04:11:58.143467 18197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260810 04:11:58.143810 19025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:58.143717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:36494)
0810 04:11:58.143766 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:58.143792 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 04:11:58.143880 18197 leader_election.cc:334] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879): Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:11:58.143918 18197 leader_election.cc:302] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cd42d8f6ef7b434f89e65b3933acc4b2; no voters: 7112ca50e5804375bb5f054255f51bb5
I20260810 04:11:58.143991 19024 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:11:58.596500 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:58.596249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:56237)
0810 04:11:58.596398 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:58.596439 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260810 04:11:58.596575 19029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:58.596329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:60385)
0810 04:11:58.596479 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:58.596518 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":57,"threads_started":1}
I20260810 04:11:58.596601 19030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:58.596430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:53001)
0810 04:11:58.596534 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:58.596563 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":43,"threads_started":1}
I20260810 04:11:59.597247 19032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:59.597034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:40775)
0810 04:11:59.597155 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:59.597193 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":56,"threads_started":1}
I20260810 04:11:59.597286 19033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:59.597112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:51459)
0810 04:11:59.597224 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:59.597252 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
I20260810 04:11:59.597270 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:11:59.596964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:38471)
0810 04:11:59.597186 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 04:11:59.597225 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":76,"threads_started":1}
I20260810 04:12:00.597929 19034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:00.597634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:42623)
0810 04:12:00.597835 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:00.597876 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":78,"threads_started":1}
I20260810 04:12:00.598006 19035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:00.597653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:35915)
0810 04:12:00.597915 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:00.597954 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":82,"threads_started":1}
I20260810 04:12:00.598170 19036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:00.597950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:50091)
0810 04:12:00.598043 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:00.598113 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":43,"threads_started":1}
I20260810 04:12:01.598755 19037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:01.598442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:33039)
0810 04:12:01.598653 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:01.598699 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":64,"threads_started":1}
I20260810 04:12:01.598771 19038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:01.598442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:58239)
0810 04:12:01.598682 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:01.598722 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":66,"threads_started":1}
I20260810 04:12:01.598949 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:01.598574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:40909)
0810 04:12:01.598782 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:01.598816 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":60,"threads_started":1}
I20260810 04:12:02.599402 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:02.599194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:44977)
0810 04:12:02.599319 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:02.599355 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260810 04:12:02.599402 19040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:02.599194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:47891)
0810 04:12:02.599319 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:02.599355 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":58,"threads_started":1}
I20260810 04:12:02.599536 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:02.599314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:34251)
0810 04:12:02.599451 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:02.599486 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":53,"threads_started":1}
I20260810 04:12:03.600054 19043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:03.599826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:48063)
0810 04:12:03.599953 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:03.599993 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
I20260810 04:12:03.600075 19044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:03.599862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:33863)
0810 04:12:03.599993 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:03.600029 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":57,"threads_started":1}
I20260810 04:12:03.600090 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:03.599931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:51957)
0810 04:12:03.600028 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:03.600053 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":48,"threads_started":1}
I20260810 04:12:03.788501 19046 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7112ca50e5804375bb5f054255f51bb5)
I20260810 04:12:03.788625 19046 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7112ca50e5804375bb5f054255f51bb5" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37879 } } peers { permanent_uuid: "cd42d8f6ef7b434f89e65b3933acc4b2" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 44473 } attrs { promote: false } } peers { permanent_uuid: "c92010f417d2440181036bddfc26021f" member_type: NON_VOTER last_known_addr { host: "127.10.249.188" port: 41101 } attrs { promote: true } }
I20260810 04:12:03.788806 19046 leader_election.cc:288] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879)
I20260810 04:12:03.789167 19047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:03.788976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:51406)
0810 04:12:03.789087 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:03.789130 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":65,"threads_started":1}
W20260810 04:12:03.789251 18197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:12:03.789611 19047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:03.789502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.0.0.1:51412)
0810 04:12:03.789548 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:03.789575 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 04:12:03.789690 18197 leader_election.cc:334] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7112ca50e5804375bb5f054255f51bb5 (127.10.249.190:37879): Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
I20260810 04:12:03.789759 18197 leader_election.cc:302] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cd42d8f6ef7b434f89e65b3933acc4b2; no voters: 7112ca50e5804375bb5f054255f51bb5
I20260810 04:12:03.789848 19046 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cd42d8f6ef7b434f89e65b3933acc4b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:12:04.600806 19051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:04.600519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:46825)
0810 04:12:04.600701 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:04.600748 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":56,"threads_started":1}
I20260810 04:12:04.600857 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:04.600501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:45843)
0810 04:12:04.600783 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:04.600813 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":41,"threads_started":1}
I20260810 04:12:04.601001 19049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:04.600454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:34567)
0810 04:12:04.600832 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:04.600867 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":66,"threads_started":1}
I20260810 04:12:05.601608 19052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:05.601315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.129:40339)
0810 04:12:05.601476 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:05.601520 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":61,"threads_started":1}
I20260810 04:12:05.601742 19053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:05.601315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.131:52595)
0810 04:12:05.601565 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:05.601619 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":63,"threads_started":1}
I20260810 04:12:05.601902 19054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:05.601556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37879 (local address 127.10.249.130:34011)
0810 04:12:05.601821 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:05.601861 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":75,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101, num_attempts: 243) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.10.249.190:37879,127.10.249.189:44473,127.10.249.188:41101, num_attempts: 1)
I20260810 04:12:05.774299 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 18366
I20260810 04:12:05.780961 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 18599
I20260810 04:12:05.786892 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 18743
I20260810 04:12:05.793002 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 18072
I20260810 04:12:05.798278 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 18271
2026-08-10T04:12:05Z chronyd exiting
I20260810 04:12:05.814600 11238 test_util.cc:175] -----------------------------------------------
I20260810 04:12:05.814647 11238 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786335069075394-11238-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (32985 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:12:05 dist-test-slave-0kls krb5kdc[19057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:12:05 dist-test-slave-0kls krb5kdc[19057](info): set up 2 sockets
Aug 10 04:12:05 dist-test-slave-0kls krb5kdc[19057](info): commencing operation
krb5kdc: starting...
W20260810 04:12:06.805356 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.990s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:12:06 dist-test-slave-0kls krb5kdc[19057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:12:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:12:06Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.190.keytab.
Entry for principal oryx/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.190.keytab.
I20260810 04:12:06.925426 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38453
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.190.keytab
--principal=oryx/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:38453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:07.004951 19071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:07.005225 19071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:07.005268 19071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:07.006430 19071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:12:07.006500 19071 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 04:12:07.006521 19071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:07.006542 19071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:07.006572 19071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:12:07.006596 19071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:12:07.008108 19071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:38453
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.190.keytab
--principal=oryx/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:07.008363 19071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:07.008572 19071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:07.013278 19076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:07.013291 19079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:07.013312 19071 server_base.cc:1034] running on GCE node
W20260810 04:12:07.013301 19077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:07.013747 19071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:07.014045 19071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:07.015264 19071 hybrid_clock.cc:648] HybridClock initialized: now 1786335127015251 us; error 27 us; skew 500 ppm
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:07.017551 19071 init.cc:377] Logged in from keytab as oryx/127.10.249.190@KRBTEST.COM (short username oryx)
I20260810 04:12:07.017993 19071 webserver.cc:460] Webserver started at http://127.10.249.190:39805/ using document root <none> and password file <none>
I20260810 04:12:07.018213 19071 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:07.018272 19071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:07.018399 19071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:07.019368 19071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "9efef90b453a4f5399b10cb00125c3a2"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "e6a61e6056ce6e458befeb0293c5c9e1"
server_key_iv: "038ef146a050537b700355381dff26f1"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.019739 19071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "9efef90b453a4f5399b10cb00125c3a2"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "e6a61e6056ce6e458befeb0293c5c9e1"
server_key_iv: "038ef146a050537b700355381dff26f1"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.021097 19071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:12:07.021848 19086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.022022 19071 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:12:07.022125 19071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "9efef90b453a4f5399b10cb00125c3a2"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "e6a61e6056ce6e458befeb0293c5c9e1"
server_key_iv: "038ef146a050537b700355381dff26f1"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.022207 19071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:07.054225 19071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:07.056044 19071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:07.056226 19071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:07.060891 19071 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:38453
I20260810 04:12:07.060941 19151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:38453 every 8 connection(s)
I20260810 04:12:07.061245 19071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:12:07.061915 19154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:07.063930 19154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: Bootstrap starting.
I20260810 04:12:07.064479 19154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:07.064764 19154 log.cc:824] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:07.065403 19154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: No bootstrap required, opened a new log
I20260810 04:12:07.067332 19154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efef90b453a4f5399b10cb00125c3a2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38453 } }
I20260810 04:12:07.067476 19154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:07.067521 19154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9efef90b453a4f5399b10cb00125c3a2, State: Initialized, Role: FOLLOWER
I20260810 04:12:07.067695 19154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efef90b453a4f5399b10cb00125c3a2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38453 } }
I20260810 04:12:07.067776 19154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:12:07.067816 19154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:12:07.067860 19154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:07.068336 19154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efef90b453a4f5399b10cb00125c3a2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38453 } }
I20260810 04:12:07.068478 19154 leader_election.cc:302] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9efef90b453a4f5399b10cb00125c3a2; no voters:
I20260810 04:12:07.068679 19154 leader_election.cc:288] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:12:07.068698 19157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:07.068805 19157 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [term 1 LEADER]: Becoming Leader. State: Replica: 9efef90b453a4f5399b10cb00125c3a2, State: Running, Role: LEADER
I20260810 04:12:07.068879 19157 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efef90b453a4f5399b10cb00125c3a2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38453 } }
I20260810 04:12:07.068922 19154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:12:07.069191 19158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9efef90b453a4f5399b10cb00125c3a2. Latest consensus state: current_term: 1 leader_uuid: "9efef90b453a4f5399b10cb00125c3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efef90b453a4f5399b10cb00125c3a2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38453 } } }
I20260810 04:12:07.069200 19159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9efef90b453a4f5399b10cb00125c3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9efef90b453a4f5399b10cb00125c3a2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38453 } } }
I20260810 04:12:07.069360 19158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:07.069372 19159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2 [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:07.069775 19166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:12:07.070329 19166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:12:07.070706 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 19071
I20260810 04:12:07.070809 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:12:07.070986 11238 external_mini_cluster.cc:1428] Setting key cc8c344a7ce4446fa1c5c128b9efe3cb
I20260810 04:12:07.072131 19166 catalog_manager.cc:1347] Generated new cluster ID: 01923edb42d8422b8d87f2c65307b347
I20260810 04:12:07.072194 19166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:12:07.078704 19166 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:12:07.079360 19166 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:12:07.082412 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.071658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60840 (local address 127.10.249.190:38453)
0810 04:12:07.072171 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.072179 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.072210 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:12:07.072320 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.072326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.072378 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.072522 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.073192 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.074628 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.075637 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.076295 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.076426 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.078913 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:07.078917 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:07.078917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:07.078928 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:07.080871 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.081276 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.081279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.081280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.081386 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.081585 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.081586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.081586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.081840 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:07.081977 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.082091 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.082210 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":69,"threads_started":1}
I20260810 04:12:07.089473 19166 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: Generated new TSK 0
I20260810 04:12:07.089615 19166 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab.
Entry for principal oryx/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab.
I20260810 04:12:07.118456 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38453
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab
--principal=oryx/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:07.196370 19180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:07.196573 19180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:07.196594 19180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:07.198239 19180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:07.198307 19180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:07.198354 19180 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:12:07.198405 19180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:12:07.200275 19180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab
--principal=oryx/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:38453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:07.200515 19180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:07.200753 19180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:07.205832 19186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:07.205845 19188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:07.206058 19180 server_base.cc:1034] running on GCE node
W20260810 04:12:07.206954 19185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:07.207293 19180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:07.207593 19180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:07.208791 19180 hybrid_clock.cc:648] HybridClock initialized: now 1786335127208769 us; error 36 us; skew 500 ppm
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:07.211321 19180 init.cc:377] Logged in from keytab as oryx/127.10.249.129@KRBTEST.COM (short username oryx)
I20260810 04:12:07.211741 19180 webserver.cc:460] Webserver started at http://127.10.249.129:41795/ using document root <none> and password file <none>
I20260810 04:12:07.211967 19180 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:07.212034 19180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:07.212157 19180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:07.213160 19180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "5b16de532d0741b6989d06266186a2d6"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "4ada47e519308ccb2b80b417c83ad995"
server_key_iv: "d7e3044f9802c1ef5aeaedf8230ed68d"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.213517 19180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "5b16de532d0741b6989d06266186a2d6"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "4ada47e519308ccb2b80b417c83ad995"
server_key_iv: "d7e3044f9802c1ef5aeaedf8230ed68d"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.214953 19180 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:12:07.215709 19195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.215890 19180 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:07.215992 19180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "5b16de532d0741b6989d06266186a2d6"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "4ada47e519308ccb2b80b417c83ad995"
server_key_iv: "d7e3044f9802c1ef5aeaedf8230ed68d"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.216080 19180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:07.226049 19180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:07.227731 19180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:07.227883 19180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:07.228423 19180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:07.228480 19180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.228523 19180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:07.228542 19180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:12:07.235921 19180 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:36587
I20260810 04:12:07.236436 19180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:12:07.236943 19315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:36587 every 8 connection(s)
I20260810 04:12:07.238139 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.228789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:44397 (local address 127.10.249.190:38453)
0810 04:12:07.228841 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.228844 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.229068 (+ 224us) server_negotiation.cc:407] Connection header received
0810 04:12:07.229739 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.229740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.229750 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.229832 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.230641 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.231112 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.232107 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.232320 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.232408 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.235402 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:07.235404 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:07.235404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:07.235412 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:07.237088 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.237419 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.237420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.237420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.237468 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.237613 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.237613 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.237613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.237709 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:07.237750 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.237996 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.238079 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:12:07.238297 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.228778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38453 (local address 127.10.249.129:44397)
0810 04:12:07.228925 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.228967 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.229625 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.229891 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.229896 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.230264 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:07.230541 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.230548 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.231210 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.231211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.232009 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.232011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.232421 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.232422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.232579 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.233090 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:07.233099 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:07.235275 (+ 2176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:07.237159 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.237164 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.237166 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.237358 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.237508 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.237508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.237509 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.237581 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.237740 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:07.237743 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:07.237906 (+ 163us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.237981 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.238109 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260810 04:12:07.238848 19316 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38453
I20260810 04:12:07.238929 19316 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:07.239130 19316 heartbeater.cc:511] Master 127.10.249.190:38453 requested a full tablet report, sending...
I20260810 04:12:07.239660 19103 ts_manager.cc:194] Registered new tserver with Master: 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587)
I20260810 04:12:07.240552 19103 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:44397
I20260810 04:12:07.242825 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 19180
I20260810 04:12:07.242944 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:12:07.243122 11238 external_mini_cluster.cc:1428] Setting key 60f06dcf331aa6e101aa9e3de210f3bf
I20260810 04:12:07.245376 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.239958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:33577 (local address 127.10.249.190:38453)
0810 04:12:07.240000 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.240002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.240132 (+ 130us) server_negotiation.cc:407] Connection header received
0810 04:12:07.240163 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.240164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.240173 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.240237 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.240496 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.241034 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.241769 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.242024 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.242079 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.242958 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:07.242959 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:07.242960 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:07.242967 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:07.244281 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.244625 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.244626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.244626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.244681 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.244862 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.244863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.244863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.244961 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:07.245029 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.245225 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.245293 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:12:07.245385 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.239902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38453 (local address 127.10.249.129:33577)
0810 04:12:07.240055 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.240072 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.240120 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.240241 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.240241 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.240382 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:07.240436 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.240437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.241113 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.241113 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.241689 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.241691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.242092 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.242093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.242142 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.242580 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:07.242584 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:07.242848 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:07.244378 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.244379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.244380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.244548 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.244745 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.244746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.244746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.244798 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.245055 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:07.245056 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:07.245107 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.245166 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.245283 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for oryx/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab.
Entry for principal oryx/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab.
I20260810 04:12:07.268067 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38453
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab
--principal=oryx/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:07.346522 19325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:07.346720 19325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:07.346743 19325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:07.347738 19325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:07.347769 19325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:07.347786 19325 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:12:07.347801 19325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:12:07.349080 19325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab
--principal=oryx/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:38453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:07.349253 19325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:07.349400 19325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:07.353951 19330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:07.353977 19325 server_base.cc:1034] running on GCE node
W20260810 04:12:07.353952 19333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:07.353989 19331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:07.354293 19325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:07.354465 19325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:07.355594 19325 hybrid_clock.cc:648] HybridClock initialized: now 1786335127355580 us; error 29 us; skew 500 ppm
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:07.358040 19325 init.cc:377] Logged in from keytab as oryx/127.10.249.130@KRBTEST.COM (short username oryx)
I20260810 04:12:07.358384 19325 webserver.cc:460] Webserver started at http://127.10.249.130:40035/ using document root <none> and password file <none>
I20260810 04:12:07.358554 19325 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:07.358588 19325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:07.358666 19325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:07.359499 19325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "93243ab619944f05aaca800579cda471"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "4e9429a3a9648e2159ee99a2b36feb1f"
server_key_iv: "cebcbd8d42ec197f0125fbff11b90b10"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.359810 19325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "93243ab619944f05aaca800579cda471"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "4e9429a3a9648e2159ee99a2b36feb1f"
server_key_iv: "cebcbd8d42ec197f0125fbff11b90b10"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.361094 19325 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:12:07.361734 19340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.361898 19325 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.362008 19325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "93243ab619944f05aaca800579cda471"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "4e9429a3a9648e2159ee99a2b36feb1f"
server_key_iv: "cebcbd8d42ec197f0125fbff11b90b10"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.362054 19325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:07.375815 19325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:07.377450 19325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:07.377552 19325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:07.378026 19325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:07.378063 19325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.378083 19325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:07.378096 19325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:12:07.385098 19325 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:46853
I20260810 04:12:07.385213 19460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:46853 every 8 connection(s)
I20260810 04:12:07.385509 19325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:12:07.388396 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.378481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:39701 (local address 127.10.249.190:38453)
0810 04:12:07.378553 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.378556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.378804 (+ 248us) server_negotiation.cc:407] Connection header received
0810 04:12:07.379431 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.379432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.379442 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.379482 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.380407 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.381216 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.382863 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.383173 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.383243 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.385629 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:07.385631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:07.385631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:07.385639 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:07.387155 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.387554 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.387556 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.387557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.387615 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.387839 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.387840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.387840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.387944 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:07.388011 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.388246 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.388316 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:12:07.388549 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.378453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38453 (local address 127.10.249.130:39701)
0810 04:12:07.378639 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.378709 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.379326 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.379554 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.379558 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.380011 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:07.380307 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.380315 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.381312 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.381313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.382777 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.382781 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.383279 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.383280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.383416 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.383819 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:07.383828 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:07.385512 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:07.387276 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.387283 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.387284 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.387475 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.387688 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.387688 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.387689 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.387782 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.388005 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:07.388011 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:07.388129 (+ 118us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.388225 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.388352 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260810 04:12:07.388962 19461 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38453
I20260810 04:12:07.389053 19461 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:07.389209 19461 heartbeater.cc:511] Master 127.10.249.190:38453 requested a full tablet report, sending...
I20260810 04:12:07.389626 19102 ts_manager.cc:194] Registered new tserver with Master: 93243ab619944f05aaca800579cda471 (127.10.249.130:46853)
I20260810 04:12:07.390080 19102 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:39701
I20260810 04:12:07.392872 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 19325
I20260810 04:12:07.392992 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:12:07.393165 11238 external_mini_cluster.cc:1428] Setting key 64be0389834ea40b73c4b3889945c135
I20260810 04:12:07.394903 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.389972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:44313 (local address 127.10.249.190:38453)
0810 04:12:07.390002 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.390004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.390117 (+ 113us) server_negotiation.cc:407] Connection header received
0810 04:12:07.390162 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.390163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.390171 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.390221 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.390556 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.391072 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.391602 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.391762 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.391804 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.392563 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:07.392564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:07.392564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:07.392568 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:07.393913 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.394269 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.394270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.394270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.394315 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.394487 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.394487 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.394488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.394600 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:07.394653 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.394801 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.394852 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12}
I20260810 04:12:07.395018 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.389917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38453 (local address 127.10.249.130:44313)
0810 04:12:07.390050 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.390060 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.390107 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.390225 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.390226 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.390397 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:07.390463 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.390464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.391146 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.391147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.391543 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.391544 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.391819 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.391820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.391862 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.392257 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:07.392261 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:07.392500 (+ 239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:07.393984 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.393985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.393985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.394202 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.394372 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.394372 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.394373 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.394436 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.394658 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:07.394659 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:07.394711 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.394778 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.394876 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for oryx/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab.
Entry for principal oryx/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab.
I20260810 04:12:07.416642 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38453
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab
--principal=oryx/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:07.495812 19470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:07.496009 19470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:07.496033 19470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:07.497136 19470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:07.497180 19470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:07.497222 19470 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:12:07.497254 19470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:12:07.498721 19470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab
--principal=oryx/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.249.190:38453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:07.498966 19470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:07.499198 19470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:07.504598 19476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:07.504609 19478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:07.504664 19470 server_base.cc:1034] running on GCE node
W20260810 04:12:07.504662 19475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:07.505028 19470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:07.505278 19470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:07.506449 19470 hybrid_clock.cc:648] HybridClock initialized: now 1786335127506445 us; error 38 us; skew 500 ppm
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:07.508812 19470 init.cc:377] Logged in from keytab as oryx/127.10.249.131@KRBTEST.COM (short username oryx)
I20260810 04:12:07.509231 19470 webserver.cc:460] Webserver started at http://127.10.249.131:42141/ using document root <none> and password file <none>
I20260810 04:12:07.509454 19470 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:07.509545 19470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:07.509690 19470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:07.510697 19470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "d0c7fe9473b743738bbb6661884b09fb"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "f8f725c7b91a02ab180b8e687c4a38f6"
server_key_iv: "cbb3255193a24df13ece30d7d8e45d15"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.511083 19470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "d0c7fe9473b743738bbb6661884b09fb"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "f8f725c7b91a02ab180b8e687c4a38f6"
server_key_iv: "cbb3255193a24df13ece30d7d8e45d15"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.512339 19470 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:12:07.513025 19486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.513186 19470 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:12:07.513290 19470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "d0c7fe9473b743738bbb6661884b09fb"
format_stamp: "Formatted at 2026-08-10 04:12:07 on dist-test-slave-0kls"
server_key: "f8f725c7b91a02ab180b8e687c4a38f6"
server_key_iv: "cbb3255193a24df13ece30d7d8e45d15"
server_key_version: "encryptionkey@0"
I20260810 04:12:07.513374 19470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:07.521212 19470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:07.522821 19470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:07.522972 19470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:07.523378 19470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:07.523435 19470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.523469 19470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:07.523509 19470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.529887 19470 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:45963
I20260810 04:12:07.529948 19611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:45963 every 8 connection(s)
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:12:07.530223 19470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:12:07.531072 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 19470
I20260810 04:12:07.531191 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:12:07.531363 11238 external_mini_cluster.cc:1428] Setting key d2dd0fed933028813221a442566012dc
I20260810 04:12:07.533115 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.523771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:45043 (local address 127.10.249.190:38453)
0810 04:12:07.523841 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.523860 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.524041 (+ 181us) server_negotiation.cc:407] Connection header received
0810 04:12:07.524630 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.524632 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.524645 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.524692 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.525513 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.526235 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.527681 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.527999 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.528082 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.530487 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:07.530488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:07.530488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:07.530495 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:07.531925 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.532261 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.532262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.532263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.532315 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.532548 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.532549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.532549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.532657 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:07.532727 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.532967 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.533037 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:12:07.533277 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.523773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38453 (local address 127.10.249.131:45043)
0810 04:12:07.523938 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.523975 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.524529 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.524752 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.524756 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.525096 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:07.525387 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.525393 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.526332 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.526334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.527580 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.527583 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.528095 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.528096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.528213 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.528671 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:07.528682 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:07.530397 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:07.531977 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.531983 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.531985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.532183 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.532379 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.532380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.532380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.532487 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.532730 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:07.532736 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:07.532853 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.532944 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.533075 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":107,"threads_started":1}
I20260810 04:12:07.533614 19612 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38453
I20260810 04:12:07.533691 19612 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:07.533870 19612 heartbeater.cc:511] Master 127.10.249.190:38453 requested a full tablet report, sending...
I20260810 04:12:07.534212 19102 ts_manager.cc:194] Registered new tserver with Master: d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963)
I20260810 04:12:07.534657 19102 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:45043
I20260810 04:12:07.539757 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.534591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:53237 (local address 127.10.249.190:38453)
0810 04:12:07.534653 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.534655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.534727 (+ 72us) server_negotiation.cc:407] Connection header received
0810 04:12:07.534791 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.534792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.534801 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.534840 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.535141 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.535638 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.536320 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.536532 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.536601 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.537400 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:07.537401 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:07.537401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:07.537407 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:07.538681 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.539019 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.539021 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.539021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.539079 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.539265 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.539266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.539266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.539369 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:07.539437 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.539599 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.539663 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:12:07.539773 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.534532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38453 (local address 127.10.249.131:53237)
0810 04:12:07.534651 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.534661 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.534738 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.534852 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.534852 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.535016 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:07.535065 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.535066 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.535737 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.535738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.536238 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.536239 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.536601 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.536602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.536662 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.537052 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:07.537056 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:07.537299 (+ 243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:07.538781 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.538782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.538783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.538947 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.539129 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:07.539130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:07.539130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:07.539185 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:07.539440 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:07.539441 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:07.539484 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.539561 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.539660 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":59,"threads_started":1}
I20260810 04:12:07.542858 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 04:12:07.563069 19177 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:07.558127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60846 (local address 127.10.249.190:38453)
0810 04:12:07.558193 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.558195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.558204 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:07.558232 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.558233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.558241 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.558286 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.558828 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.559260 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.559919 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.560093 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.560139 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.562934 (+ 2795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60846: BlockingRecv error: recv got EOF from 127.0.0.1:60846 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 04:12:07 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:12:07.569931 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.563738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60856 (local address 127.10.249.190:38453)
0810 04:12:07.563771 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.563773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.563852 (+ 79us) server_negotiation.cc:407] Connection header received
0810 04:12:07.563885 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.563886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.563893 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.563937 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:07.564380 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.564846 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.565555 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.565735 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.565842 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.567731 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:07.567733 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:07.567733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:07.567739 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:07.568889 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.569247 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.569248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.569248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.569294 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:07.569430 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:07.569430 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:07.569430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:07.569508 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:07.569639 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.569724 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.569830 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:12:07.571362 19102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:12:07.572795 19102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:12:07.578526 19632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.574787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36587 (local address 127.0.0.1:60710)
0810 04:12:07.575105 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.575141 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.575268 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.575525 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.575529 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.575530 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:07.575612 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.575614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.576551 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.576552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.577316 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.577318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.578216 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.578217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.578315 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.578331 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.578404 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.578457 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":51,"threads_started":1}
I20260810 04:12:07.578562 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.574927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60710 (local address 127.10.249.129:36587)
0810 04:12:07.575070 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.575076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.575253 (+ 177us) server_negotiation.cc:407] Connection header received
0810 04:12:07.575349 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.575352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.575370 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.575447 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:07.575699 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.576457 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.577415 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.578097 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.578235 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.578296 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.578423 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.578465 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260810 04:12:07.579442 19633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.574971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46853 (local address 127.0.0.1:34996)
0810 04:12:07.575368 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.575378 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.575428 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.575660 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.575661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.575664 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:07.575719 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.575720 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.576994 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.576995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.578283 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.578285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.579237 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.579238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.579278 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.579281 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.579343 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.579381 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":55,"thread_start_us":44,"threads_started":1}
I20260810 04:12:07.579491 19637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.575134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.10.249.130:46853)
0810 04:12:07.575296 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.575300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.575437 (+ 137us) server_negotiation.cc:407] Connection header received
0810 04:12:07.575495 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.575497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.575511 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.575590 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:07.575801 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.576880 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.578381 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.579078 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.579165 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.579209 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.579368 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.579403 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":101,"threads_started":1}
I20260810 04:12:07.579461 19245 tablet_service.cc:1467] Processing CreateTablet for tablet af965c10f3dd4b16bcef746d0b63c1c4 (DEFAULT_TABLE table=test-table [id=1db27e67b54d4520a22f0138c94cb617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:07.579878 19245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af965c10f3dd4b16bcef746d0b63c1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:07.580399 19391 tablet_service.cc:1467] Processing CreateTablet for tablet af965c10f3dd4b16bcef746d0b63c1c4 (DEFAULT_TABLE table=test-table [id=1db27e67b54d4520a22f0138c94cb617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:07.580711 19391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af965c10f3dd4b16bcef746d0b63c1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:07.583048 19638 tablet_bootstrap.cc:492] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Bootstrap starting.
I20260810 04:12:07.583309 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.575003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36258 (local address 127.10.249.131:45963)
0810 04:12:07.575189 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.575194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.575378 (+ 184us) server_negotiation.cc:407] Connection header received
0810 04:12:07.575475 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.575478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.575495 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.575611 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:07.575827 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.576889 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.578356 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.579036 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.579140 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.579199 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.583198 (+ 3999us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.583245 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":77,"threads_started":1}
I20260810 04:12:07.583534 19635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.574787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:45963 (local address 127.0.0.1:36258)
0810 04:12:07.575319 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.575329 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.575387 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.575712 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.575712 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.575714 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:07.575745 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.575747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.576994 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.576995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.578282 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.578285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.583050 (+ 4765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.583051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.583111 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.583115 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.583429 (+ 314us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.583470 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":64,"thread_start_us":51,"threads_started":1}
I20260810 04:12:07.583695 19638 tablet_bootstrap.cc:654] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:07.584028 19638 log.cc:824] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:07.584125 19542 tablet_service.cc:1467] Processing CreateTablet for tablet af965c10f3dd4b16bcef746d0b63c1c4 (DEFAULT_TABLE table=test-table [id=1db27e67b54d4520a22f0138c94cb617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:07.584450 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af965c10f3dd4b16bcef746d0b63c1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:07.584885 19638 tablet_bootstrap.cc:492] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: No bootstrap required, opened a new log
I20260810 04:12:07.584954 19638 ts_tablet_manager.cc:1397] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:12:07.585954 19639 tablet_bootstrap.cc:492] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Bootstrap starting.
I20260810 04:12:07.586650 19639 tablet_bootstrap.cc:654] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:07.586956 19639 log.cc:824] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:07.586901 19638 raft_consensus.cc:348] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.587065 19638 raft_consensus.cc:374] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:07.587131 19638 raft_consensus.cc:729] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b16de532d0741b6989d06266186a2d6, State: Initialized, Role: FOLLOWER
I20260810 04:12:07.587321 19638 consensus_queue.cc:260] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.587693 19316 heartbeater.cc:503] Master 127.10.249.190:38453 was elected leader, sending a full tablet report...
I20260810 04:12:07.587786 19639 tablet_bootstrap.cc:492] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: No bootstrap required, opened a new log
I20260810 04:12:07.587690 19638 ts_tablet_manager.cc:1428] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:12:07.587913 19639 ts_tablet_manager.cc:1397] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:12:07.588188 19643 tablet_bootstrap.cc:492] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Bootstrap starting.
I20260810 04:12:07.588922 19643 tablet_bootstrap.cc:654] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:07.589232 19643 log.cc:824] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:07.589725 19639 raft_consensus.cc:348] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.589936 19639 raft_consensus.cc:374] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:07.590003 19639 raft_consensus.cc:729] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93243ab619944f05aaca800579cda471, State: Initialized, Role: FOLLOWER
I20260810 04:12:07.590059 19643 tablet_bootstrap.cc:492] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: No bootstrap required, opened a new log
I20260810 04:12:07.590178 19643 ts_tablet_manager.cc:1397] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:12:07.590129 19639 consensus_queue.cc:260] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.590396 19639 ts_tablet_manager.cc:1428] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:12:07.590462 19461 heartbeater.cc:503] Master 127.10.249.190:38453 was elected leader, sending a full tablet report...
I20260810 04:12:07.591980 19643 raft_consensus.cc:348] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.592227 19643 raft_consensus.cc:374] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:07.592296 19643 raft_consensus.cc:729] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0c7fe9473b743738bbb6661884b09fb, State: Initialized, Role: FOLLOWER
I20260810 04:12:07.592418 19643 consensus_queue.cc:260] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.592666 19643 ts_tablet_manager.cc:1428] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:12:07.592731 19612 heartbeater.cc:503] Master 127.10.249.190:38453 was elected leader, sending a full tablet report...
W20260810 04:12:07.636443 19462 tablet.cc:2369] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:12:07.737257 19317 tablet.cc:2369] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:12:07.767207 19645 raft_consensus.cc:482] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:12:07.767343 19645 raft_consensus.cc:504] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.767788 19645 leader_election.cc:288] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587), d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963)
I20260810 04:12:07.771520 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.768005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:55653 (local address 127.10.249.129:36587)
0810 04:12:07.768063 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.768066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.768077 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:12:07.768109 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.768110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.768120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.768215 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:07.768400 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.769187 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.770651 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.771155 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.771233 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.771242 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.771424 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.771459 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:12:07.771560 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.767940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36587 (local address 127.10.249.130:55653)
0810 04:12:07.767976 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.767988 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.768033 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.768227 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.768228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.768231 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:07.768323 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.768326 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.769266 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.769267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.770564 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.770567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.771240 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.771241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.771351 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.771355 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.771411 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.771459 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16,"mutex_wait_us":56}
I20260810 04:12:07.771850 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.768096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:56057 (local address 127.10.249.131:45963)
0810 04:12:07.768142 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.768143 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.768217 (+ 74us) server_negotiation.cc:407] Connection header received
0810 04:12:07.768249 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.768250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.768260 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.768314 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:07.768549 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.769258 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.770649 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.771165 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.771233 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.771242 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.771729 (+ 487us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.771794 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:12:07.771874 19266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af965c10f3dd4b16bcef746d0b63c1c4" candidate_uuid: "93243ab619944f05aaca800579cda471" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b16de532d0741b6989d06266186a2d6" is_pre_election: true
I20260810 04:12:07.772022 19266 raft_consensus.cc:2454] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93243ab619944f05aaca800579cda471 in term 0.
I20260810 04:12:07.772073 19647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.767940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:45963 (local address 127.10.249.130:56057)
0810 04:12:07.768132 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:07.768139 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:07.768204 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:07.768337 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:07.768338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:07.768349 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:07.768410 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.768413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.769332 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.769333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.770564 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:07.770567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.771240 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.771241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:07.771611 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.771615 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:07.771939 (+ 324us) client_negotiation.cc:240] Negotiation successful
0810 04:12:07.771980 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":56,"thread_start_us":89,"threads_started":1}
I20260810 04:12:07.772265 19342 leader_election.cc:302] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, 93243ab619944f05aaca800579cda471; no voters:
I20260810 04:12:07.772403 19645 raft_consensus.cc:2781] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:12:07.772389 19562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af965c10f3dd4b16bcef746d0b63c1c4" candidate_uuid: "93243ab619944f05aaca800579cda471" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0c7fe9473b743738bbb6661884b09fb" is_pre_election: true
I20260810 04:12:07.772459 19645 raft_consensus.cc:482] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:12:07.772482 19645 raft_consensus.cc:3037] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:07.772531 19562 raft_consensus.cc:2454] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93243ab619944f05aaca800579cda471 in term 0.
I20260810 04:12:07.773217 19645 raft_consensus.cc:504] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.773352 19645 leader_election.cc:288] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [CANDIDATE]: Term 1 election: Requested vote from peers 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587), d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963)
I20260810 04:12:07.773497 19562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af965c10f3dd4b16bcef746d0b63c1c4" candidate_uuid: "93243ab619944f05aaca800579cda471" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0c7fe9473b743738bbb6661884b09fb"
I20260810 04:12:07.773496 19266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af965c10f3dd4b16bcef746d0b63c1c4" candidate_uuid: "93243ab619944f05aaca800579cda471" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b16de532d0741b6989d06266186a2d6"
I20260810 04:12:07.773572 19562 raft_consensus.cc:3037] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:07.773573 19266 raft_consensus.cc:3037] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:07.774433 19266 raft_consensus.cc:2454] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93243ab619944f05aaca800579cda471 in term 1.
I20260810 04:12:07.774442 19562 raft_consensus.cc:2454] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93243ab619944f05aaca800579cda471 in term 1.
I20260810 04:12:07.774600 19342 leader_election.cc:302] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, 93243ab619944f05aaca800579cda471; no voters:
I20260810 04:12:07.774691 19645 raft_consensus.cc:2781] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:07.774825 19645 raft_consensus.cc:686] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 1 LEADER]: Becoming Leader. State: Replica: 93243ab619944f05aaca800579cda471, State: Running, Role: LEADER
I20260810 04:12:07.774932 19645 consensus_queue.cc:237] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } }
I20260810 04:12:07.775808 19102 catalog_manager.cc:5495] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93243ab619944f05aaca800579cda471 (127.10.249.130). New cstate: current_term: 1 leader_uuid: "93243ab619944f05aaca800579cda471" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } health_report { overall_health: HEALTHY } } }
W20260810 04:12:07.780861 19613 tablet.cc:2369] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:12:07.807915 19637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:07.805588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34998 (local address 127.10.249.130:46853)
0810 04:12:07.805673 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:07.805675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:07.805684 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:07.805724 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:07.805725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:07.805742 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:07.805869 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:07.806003 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.806488 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.807187 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:07.807377 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:07.807444 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:07.807603 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:07.807701 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:07.807789 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:07.807806 (+ 17us) server_negotiation.cc:299] Negotiation successful
0810 04:12:07.807824 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:12:07.809515 19266 raft_consensus.cc:1261] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Refusing update from remote peer 93243ab619944f05aaca800579cda471: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:07.809515 19562 raft_consensus.cc:1261] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Refusing update from remote peer 93243ab619944f05aaca800579cda471: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:07.809875 19648 consensus_queue.cc:1035] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:07.810007 19645 consensus_queue.cc:1035] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:07.812081 19652 mvcc.cc:205] Tried to move back new op lower bound from 7316828683505254400 to 7316828683366572032. Current Snapshot: MvccSnapshot[applied={T|T < 7316828683505254400}]
I20260810 04:12:07.812215 19653 mvcc.cc:205] Tried to move back new op lower bound from 7316828683505254400 to 7316828683366572032. Current Snapshot: MvccSnapshot[applied={T|T < 7316828683505254400}]
I20260810 04:12:07.812891 19654 mvcc.cc:205] Tried to move back new op lower bound from 7316828683505254400 to 7316828683366572032. Current Snapshot: MvccSnapshot[applied={T|T < 7316828683505254400}]
I20260810 04:12:07.814211 19102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:07.814301 19102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:07.815004 19102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: Sending DeleteTablet for 3 replicas of tablet af965c10f3dd4b16bcef746d0b63c1c4
I20260810 04:12:07.815352 19391 tablet_service.cc:1514] Processing DeleteTablet for tablet af965c10f3dd4b16bcef746d0b63c1c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:07 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:34996
I20260810 04:12:07.815353 19245 tablet_service.cc:1514] Processing DeleteTablet for tablet af965c10f3dd4b16bcef746d0b63c1c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:07 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:60710
I20260810 04:12:07.815353 19542 tablet_service.cc:1514] Processing DeleteTablet for tablet af965c10f3dd4b16bcef746d0b63c1c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:07 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:36258
I20260810 04:12:07.815543 19662 tablet_replica.cc:330] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: stopping tablet replica
I20260810 04:12:07.815678 19662 raft_consensus.cc:2229] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:07.815795 19662 raft_consensus.cc:2258] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:07.815831 19102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:12:07.815972 19102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:12:07.816234 19662 ts_tablet_manager.cc:1905] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:07.817037 19245 tablet_service.cc:1467] Processing CreateTablet for tablet ea07d5dde81d4e1e8d4020cfbe6f7478 (DEFAULT_TABLE table=test-table [id=e4e6d522328043d8b5700df25ca15d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:07.817237 19245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea07d5dde81d4e1e8d4020cfbe6f7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:07.817332 19542 tablet_service.cc:1467] Processing CreateTablet for tablet ea07d5dde81d4e1e8d4020cfbe6f7478 (DEFAULT_TABLE table=test-table [id=e4e6d522328043d8b5700df25ca15d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:07.817437 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea07d5dde81d4e1e8d4020cfbe6f7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:07.817931 19391 tablet_service.cc:1467] Processing CreateTablet for tablet ea07d5dde81d4e1e8d4020cfbe6f7478 (DEFAULT_TABLE table=test-table [id=e4e6d522328043d8b5700df25ca15d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:07.817947 19662 ts_tablet_manager.cc:1918] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:12:07.818003 19662 log.cc:1196] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/af965c10f3dd4b16bcef746d0b63c1c4
I20260810 04:12:07.818034 19391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea07d5dde81d4e1e8d4020cfbe6f7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:07.818246 19662 ts_tablet_manager.cc:1939] T af965c10f3dd4b16bcef746d0b63c1c4 P 5b16de532d0741b6989d06266186a2d6: Deleting consensus metadata
I20260810 04:12:07.818500 19638 tablet_bootstrap.cc:492] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: Bootstrap starting.
I20260810 04:12:07.818871 19638 tablet_bootstrap.cc:654] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:07.819334 19639 tablet_bootstrap.cc:492] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: Bootstrap starting.
I20260810 04:12:07.819366 19088 catalog_manager.cc:4841] TS 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587): tablet af965c10f3dd4b16bcef746d0b63c1c4 (table test-table [id=1db27e67b54d4520a22f0138c94cb617]) successfully deleted
I20260810 04:12:07.819643 19638 tablet_bootstrap.cc:492] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: No bootstrap required, opened a new log
I20260810 04:12:07.819695 19638 ts_tablet_manager.cc:1397] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:07.819764 19639 tablet_bootstrap.cc:654] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:07.819998 19638 raft_consensus.cc:348] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:07.820048 19638 raft_consensus.cc:374] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:07.820061 19638 raft_consensus.cc:729] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b16de532d0741b6989d06266186a2d6, State: Initialized, Role: FOLLOWER
I20260810 04:12:07.820111 19638 consensus_queue.cc:260] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:07.820236 19638 ts_tablet_manager.cc:1428] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 04:12:07.821291 19643 tablet_bootstrap.cc:492] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: Bootstrap starting.
I20260810 04:12:07.821398 19639 tablet_bootstrap.cc:492] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: No bootstrap required, opened a new log
I20260810 04:12:07.821440 19639 ts_tablet_manager.cc:1397] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:12:07.821587 19639 raft_consensus.cc:348] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:07.821646 19639 raft_consensus.cc:374] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:07.821658 19643 tablet_bootstrap.cc:654] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:07.821666 19639 raft_consensus.cc:729] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93243ab619944f05aaca800579cda471, State: Initialized, Role: FOLLOWER
I20260810 04:12:07.821715 19639 consensus_queue.cc:260] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:07.821821 19639 ts_tablet_manager.cc:1428] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:07.822386 19643 tablet_bootstrap.cc:492] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: No bootstrap required, opened a new log
I20260810 04:12:07.822445 19643 ts_tablet_manager.cc:1397] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:12:07.822592 19643 raft_consensus.cc:348] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:07.822640 19643 raft_consensus.cc:374] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:07.822659 19643 raft_consensus.cc:729] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0c7fe9473b743738bbb6661884b09fb, State: Initialized, Role: FOLLOWER
I20260810 04:12:07.822710 19643 consensus_queue.cc:260] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:07.822793 19643 ts_tablet_manager.cc:1428] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:07.825887 19663 tablet_replica.cc:330] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: stopping tablet replica
I20260810 04:12:07.825898 19664 tablet_replica.cc:330] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: stopping tablet replica
I20260810 04:12:07.826005 19663 raft_consensus.cc:2229] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:12:07.826016 19664 raft_consensus.cc:2229] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:07.826119 19663 raft_consensus.cc:2258] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:07.826126 19664 raft_consensus.cc:2258] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:07.826485 19663 ts_tablet_manager.cc:1905] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:07.826637 19664 ts_tablet_manager.cc:1905] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:07.827870 19663 ts_tablet_manager.cc:1918] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:12:07.827870 19664 ts_tablet_manager.cc:1918] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:12:07.827944 19664 log.cc:1196] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/af965c10f3dd4b16bcef746d0b63c1c4
I20260810 04:12:07.827944 19663 log.cc:1196] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/af965c10f3dd4b16bcef746d0b63c1c4
I20260810 04:12:07.828228 19664 ts_tablet_manager.cc:1939] T af965c10f3dd4b16bcef746d0b63c1c4 P d0c7fe9473b743738bbb6661884b09fb: Deleting consensus metadata
I20260810 04:12:07.828228 19663 ts_tablet_manager.cc:1939] T af965c10f3dd4b16bcef746d0b63c1c4 P 93243ab619944f05aaca800579cda471: Deleting consensus metadata
I20260810 04:12:07.828624 19089 catalog_manager.cc:4841] TS 93243ab619944f05aaca800579cda471 (127.10.249.130:46853): tablet af965c10f3dd4b16bcef746d0b63c1c4 (table test-table [id=1db27e67b54d4520a22f0138c94cb617]) successfully deleted
I20260810 04:12:07.828722 19089 catalog_manager.cc:4841] TS d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963): tablet af965c10f3dd4b16bcef746d0b63c1c4 (table test-table [id=1db27e67b54d4520a22f0138c94cb617]) successfully deleted
I20260810 04:12:08.051128 19642 raft_consensus.cc:482] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:12:08.051239 19642 raft_consensus.cc:504] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.051568 19642 leader_election.cc:288] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93243ab619944f05aaca800579cda471 (127.10.249.130:46853), d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963)
I20260810 04:12:08.054392 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.051969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:46567 (local address 127.10.249.131:45963)
0810 04:12:08.052015 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.052017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.052084 (+ 67us) server_negotiation.cc:407] Connection header received
0810 04:12:08.052156 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.052157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.052170 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.052223 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:08.052360 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.052751 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.053612 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.054009 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.054084 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.054093 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.054283 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.054318 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:12:08.054390 19637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.051815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:40485 (local address 127.10.249.130:46853)
0810 04:12:08.051883 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.051884 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.051909 (+ 25us) server_negotiation.cc:407] Connection header received
0810 04:12:08.051959 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.051960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.051971 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.052035 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:08.052217 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.052637 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.053588 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.053967 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.054096 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.054105 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.054274 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.054310 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:12:08.054415 19668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.051735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46853 (local address 127.10.249.129:40485)
0810 04:12:08.051843 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.051854 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.051902 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.052045 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.052046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.052049 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:08.052142 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.052144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.052719 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.052720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.053472 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.053484 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.054130 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.054131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.054200 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.054204 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.054269 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.054310 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":2,"thread_start_us":65,"threads_started":1}
I20260810 04:12:08.054422 19669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.051901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:45963 (local address 127.10.249.129:46567)
0810 04:12:08.052029 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.052036 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.052096 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.052228 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.052229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.052230 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:08.052296 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.052297 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.052833 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.052834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.053516 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.053518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.054116 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.054118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.054201 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.054205 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.054276 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.054316 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":4,"thread_start_us":70,"threads_started":1}
I20260810 04:12:08.054651 19412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea07d5dde81d4e1e8d4020cfbe6f7478" candidate_uuid: "5b16de532d0741b6989d06266186a2d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93243ab619944f05aaca800579cda471" is_pre_election: true
I20260810 04:12:08.054802 19412 raft_consensus.cc:2454] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b16de532d0741b6989d06266186a2d6 in term 0.
I20260810 04:12:08.055003 19198 leader_election.cc:302] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, 93243ab619944f05aaca800579cda471; no voters:
I20260810 04:12:08.055019 19562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea07d5dde81d4e1e8d4020cfbe6f7478" candidate_uuid: "5b16de532d0741b6989d06266186a2d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0c7fe9473b743738bbb6661884b09fb" is_pre_election: true
I20260810 04:12:08.055133 19562 raft_consensus.cc:2454] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b16de532d0741b6989d06266186a2d6 in term 0.
I20260810 04:12:08.055159 19642 raft_consensus.cc:2781] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:12:08.055200 19642 raft_consensus.cc:482] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:12:08.055231 19642 raft_consensus.cc:3037] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.055919 19642 raft_consensus.cc:504] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.056061 19642 leader_election.cc:288] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [CANDIDATE]: Term 1 election: Requested vote from peers 93243ab619944f05aaca800579cda471 (127.10.249.130:46853), d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963)
I20260810 04:12:08.056205 19412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea07d5dde81d4e1e8d4020cfbe6f7478" candidate_uuid: "5b16de532d0741b6989d06266186a2d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93243ab619944f05aaca800579cda471"
I20260810 04:12:08.056288 19412 raft_consensus.cc:3037] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.056293 19562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea07d5dde81d4e1e8d4020cfbe6f7478" candidate_uuid: "5b16de532d0741b6989d06266186a2d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0c7fe9473b743738bbb6661884b09fb"
I20260810 04:12:08.056361 19562 raft_consensus.cc:3037] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.057044 19562 raft_consensus.cc:2454] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b16de532d0741b6989d06266186a2d6 in term 1.
I20260810 04:12:08.057093 19412 raft_consensus.cc:2454] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b16de532d0741b6989d06266186a2d6 in term 1.
I20260810 04:12:08.057219 19198 leader_election.cc:302] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, d0c7fe9473b743738bbb6661884b09fb; no voters:
I20260810 04:12:08.057291 19642 raft_consensus.cc:2781] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:08.057435 19642 raft_consensus.cc:686] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 1 LEADER]: Becoming Leader. State: Replica: 5b16de532d0741b6989d06266186a2d6, State: Running, Role: LEADER
I20260810 04:12:08.057511 19642 consensus_queue.cc:237] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.058218 19102 catalog_manager.cc:5495] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b16de532d0741b6989d06266186a2d6 (127.10.249.129). New cstate: current_term: 1 leader_uuid: "5b16de532d0741b6989d06266186a2d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } health_report { overall_health: UNKNOWN } } }
Aug 10 04:12:08 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335127, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.190@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:12:08.124787 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.118374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38453 (local address 127.0.0.1:60866)
0810 04:12:08.118522 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.118546 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.118588 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.118717 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.118718 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.118996 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:08.119037 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.119039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.119631 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.119632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.120136 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.120138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.120454 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.120455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.120493 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.120966 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:08.120983 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:08.122261 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:08.123749 (+ 1488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:08.123755 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:08.123757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:08.123947 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:08.124160 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:08.124161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:08.124161 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:08.124214 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:08.124504 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:08.124511 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:08.124551 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.124618 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.124716 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":81,"threads_started":1}
I20260810 04:12:08.124855 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.118420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60866 (local address 127.10.249.190:38453)
0810 04:12:08.118568 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.118569 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.118591 (+ 22us) server_negotiation.cc:407] Connection header received
0810 04:12:08.118635 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.118635 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.118645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.118702 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:08.119097 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.119573 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.120213 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.120392 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.120443 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.122331 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:08.122332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:08.122333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:08.122338 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:08.123686 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:08.124009 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:08.124010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:08.124010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:08.124064 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:08.124325 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:08.124326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:08.124326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:08.124447 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:08.124500 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.124677 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.124766 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260810 04:12:08.127003 19102 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:60866:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 04:12:08.127285 19102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:12:08.128825 19542 tablet_service.cc:1467] Processing CreateTablet for tablet f41af327d3194ab1bc27018e684393e5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3cbac6b2b9024521970a0c7636e3e485]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:12:08.128836 19245 tablet_service.cc:1467] Processing CreateTablet for tablet f41af327d3194ab1bc27018e684393e5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3cbac6b2b9024521970a0c7636e3e485]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:12:08.128901 19391 tablet_service.cc:1467] Processing CreateTablet for tablet f41af327d3194ab1bc27018e684393e5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3cbac6b2b9024521970a0c7636e3e485]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:12:08.129012 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f41af327d3194ab1bc27018e684393e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.129012 19245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f41af327d3194ab1bc27018e684393e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.129019 19391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f41af327d3194ab1bc27018e684393e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.130278 19643 tablet_bootstrap.cc:492] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: Bootstrap starting.
I20260810 04:12:08.130507 19639 tablet_bootstrap.cc:492] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: Bootstrap starting.
I20260810 04:12:08.130522 19638 tablet_bootstrap.cc:492] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: Bootstrap starting.
I20260810 04:12:08.130722 19643 tablet_bootstrap.cc:654] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.130874 19639 tablet_bootstrap.cc:654] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.130903 19638 tablet_bootstrap.cc:654] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.131448 19639 tablet_bootstrap.cc:492] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: No bootstrap required, opened a new log
I20260810 04:12:08.131503 19639 ts_tablet_manager.cc:1397] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:08.131587 19638 tablet_bootstrap.cc:492] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: No bootstrap required, opened a new log
I20260810 04:12:08.131624 19638 ts_tablet_manager.cc:1397] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:08.131640 19639 raft_consensus.cc:348] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.131711 19639 raft_consensus.cc:374] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.131712 19643 tablet_bootstrap.cc:492] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: No bootstrap required, opened a new log
I20260810 04:12:08.131732 19639 raft_consensus.cc:729] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93243ab619944f05aaca800579cda471, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.131747 19643 ts_tablet_manager.cc:1397] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:12:08.131783 19639 consensus_queue.cc:260] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.131773 19638 raft_consensus.cc:348] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.131850 19638 raft_consensus.cc:374] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.131870 19638 raft_consensus.cc:729] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b16de532d0741b6989d06266186a2d6, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.131877 19639 ts_tablet_manager.cc:1428] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:08.131914 19638 consensus_queue.cc:260] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.131903 19643 raft_consensus.cc:348] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.131899 19657 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.131971 19643 raft_consensus.cc:374] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.131980 19657 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:12:08.132007 19643 raft_consensus.cc:729] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0c7fe9473b743738bbb6661884b09fb, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.132014 19638 ts_tablet_manager.cc:1428] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:08.132050 19643 consensus_queue.cc:260] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.132138 19643 ts_tablet_manager.cc:1428] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 04:12:08.132185 19646 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.132282 19646 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:12:08.132236 19642 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.132325 19642 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:12:08.196870 19646 raft_consensus.cc:482] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:12:08.196996 19646 raft_consensus.cc:504] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.197352 19646 leader_election.cc:288] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587), 93243ab619944f05aaca800579cda471 (127.10.249.130:46853)
I20260810 04:12:08.201459 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.197638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:55389 (local address 127.10.249.129:36587)
0810 04:12:08.197688 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.197690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.197793 (+ 103us) server_negotiation.cc:407] Connection header received
0810 04:12:08.197868 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.197869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.197879 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.197950 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:08.198154 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.198876 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.200483 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.201082 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.201155 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.201163 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.201356 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.201392 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:12:08.201470 19637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.197658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:45225 (local address 127.10.249.130:46853)
0810 04:12:08.197715 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.197717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.197793 (+ 76us) server_negotiation.cc:407] Connection header received
0810 04:12:08.197867 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.197868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.197879 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.197950 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:08.198154 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.198882 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.200473 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.200983 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.201074 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.201084 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.201343 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.201392 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:12:08.201721 19683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.197543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36587 (local address 127.10.249.131:55389)
0810 04:12:08.197706 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.197718 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.197805 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.197963 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.197964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.197967 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:08.198078 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.198082 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.198961 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.198962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.200364 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.200368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.201213 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.201213 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.201277 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.201281 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.201543 (+ 262us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.201619 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":136,"thread_start_us":89,"threads_started":1}
I20260810 04:12:08.202073 19266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41af327d3194ab1bc27018e684393e5" candidate_uuid: "d0c7fe9473b743738bbb6661884b09fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b16de532d0741b6989d06266186a2d6" is_pre_election: true
I20260810 04:12:08.202210 19266 raft_consensus.cc:2454] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0c7fe9473b743738bbb6661884b09fb in term 0.
I20260810 04:12:08.201730 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.197544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46853 (local address 127.10.249.131:45225)
0810 04:12:08.197706 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.197718 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.197805 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.197963 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.197964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.197967 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:08.198078 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.198081 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.198963 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.198964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.200365 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.200368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.201096 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.201098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.201205 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.201209 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.201606 (+ 397us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.201636 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":85,"thread_start_us":79,"threads_started":1}
I20260810 04:12:08.202955 19412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41af327d3194ab1bc27018e684393e5" candidate_uuid: "d0c7fe9473b743738bbb6661884b09fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93243ab619944f05aaca800579cda471" is_pre_election: true
I20260810 04:12:08.202962 19488 leader_election.cc:302] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, d0c7fe9473b743738bbb6661884b09fb; no voters:
I20260810 04:12:08.203054 19412 raft_consensus.cc:2454] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0c7fe9473b743738bbb6661884b09fb in term 0.
I20260810 04:12:08.203109 19646 raft_consensus.cc:2781] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:12:08.203153 19646 raft_consensus.cc:482] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:12:08.203181 19646 raft_consensus.cc:3037] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.203868 19646 raft_consensus.cc:504] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.204025 19646 leader_election.cc:288] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [CANDIDATE]: Term 1 election: Requested vote from peers 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587), 93243ab619944f05aaca800579cda471 (127.10.249.130:46853)
I20260810 04:12:08.204164 19266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41af327d3194ab1bc27018e684393e5" candidate_uuid: "d0c7fe9473b743738bbb6661884b09fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b16de532d0741b6989d06266186a2d6"
I20260810 04:12:08.204264 19266 raft_consensus.cc:3037] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.204224 19412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41af327d3194ab1bc27018e684393e5" candidate_uuid: "d0c7fe9473b743738bbb6661884b09fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93243ab619944f05aaca800579cda471"
I20260810 04:12:08.204331 19412 raft_consensus.cc:3037] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.204867 19266 raft_consensus.cc:2454] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0c7fe9473b743738bbb6661884b09fb in term 1.
I20260810 04:12:08.204998 19412 raft_consensus.cc:2454] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0c7fe9473b743738bbb6661884b09fb in term 1.
I20260810 04:12:08.205020 19488 leader_election.cc:302] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, d0c7fe9473b743738bbb6661884b09fb; no voters:
I20260810 04:12:08.205215 19646 raft_consensus.cc:2781] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:08.205377 19646 raft_consensus.cc:686] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [term 1 LEADER]: Becoming Leader. State: Replica: d0c7fe9473b743738bbb6661884b09fb, State: Running, Role: LEADER
I20260810 04:12:08.205468 19646 consensus_queue.cc:237] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.205837 19686 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: TxnStatusTablet state changed. Reason: New leader d0c7fe9473b743738bbb6661884b09fb. Latest consensus state: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.205940 19686 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:12:08.206200 19688 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 04:12:08.206229 19102 catalog_manager.cc:5495] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb reported cstate change: term changed from 0 to 1, leader changed from <none> to d0c7fe9473b743738bbb6661884b09fb (127.10.249.131). New cstate: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260810 04:12:08.206334 19688 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 04:12:08.224947 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.222361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36260 (local address 127.10.249.131:45963)
0810 04:12:08.222427 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.222429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.222442 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:12:08.222483 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.222484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.222504 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.222585 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:08.222681 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.223427 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.224161 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.224338 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.224405 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.224574 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.224729 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.224784 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.224841 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.224859 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:12:08.224942 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.222271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:45963 (local address 127.0.0.1:36260)
0810 04:12:08.222354 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.222367 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.222425 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.222582 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.222583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.222584 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:12:08.222629 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.222632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.223508 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.223508 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.224078 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.224079 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.224405 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.224406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.224466 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.224480 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.224781 (+ 301us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.224791 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.224829 (+ 38us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.224877 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 04:12:08.226269 19266 raft_consensus.cc:1261] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Refusing update from remote peer d0c7fe9473b743738bbb6661884b09fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:08.226400 19412 raft_consensus.cc:1261] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Refusing update from remote peer d0c7fe9473b743738bbb6661884b09fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:08.226742 19686 consensus_queue.cc:1035] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:08.226884 19646 consensus_queue.cc:1035] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:08.227519 19657 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: TxnStatusTablet state changed. Reason: New leader d0c7fe9473b743738bbb6661884b09fb. Latest consensus state: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.227598 19657 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:12:08.227691 19642 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: TxnStatusTablet state changed. Reason: New leader d0c7fe9473b743738bbb6661884b09fb. Latest consensus state: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.227787 19642 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:12:08.228336 19686 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.228417 19686 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:12:08.228505 19686 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.228546 19686 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P d0c7fe9473b743738bbb6661884b09fb: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:12:08.229184 19642 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.229269 19642 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P 5b16de532d0741b6989d06266186a2d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:12:08.230162 19657 tablet_replica.cc:439] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } } }
I20260810 04:12:08.230283 19657 tablet_replica.cc:442] T f41af327d3194ab1bc27018e684393e5 P 93243ab619944f05aaca800579cda471: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:12:08.232738 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.230243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60716 (local address 127.10.249.129:36587)
0810 04:12:08.230293 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.230295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.230302 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:12:08.230341 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.230341 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.230380 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.230445 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:08.230563 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.231288 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.231978 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.232277 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.232344 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.232451 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.232562 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.232628 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.232649 (+ 21us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.232669 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:12:08.237442 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.235092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:51893 (local address 127.10.249.131:45963)
0810 04:12:08.235151 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.235153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.235162 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:08.235233 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.235234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.235243 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.235313 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:08.235450 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.235966 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.236790 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.236980 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.237052 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.237212 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.237250 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.237312 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.237368 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.237383 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:12:08.237478 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.234966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:45963 (local address 127.10.249.129:51893)
0810 04:12:08.235114 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.235125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.235175 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.235318 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.235319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.235320 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:12:08.235380 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.235382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.236042 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.236043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.236712 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.236714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.237053 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.237054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.237109 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.237122 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.237314 (+ 192us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.237316 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.237363 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.237401 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260810 04:12:08.240756 19412 raft_consensus.cc:1261] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Refusing update from remote peer 5b16de532d0741b6989d06266186a2d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:08.240826 19562 raft_consensus.cc:1261] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Refusing update from remote peer 5b16de532d0741b6989d06266186a2d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:08.241015 19642 consensus_queue.cc:1035] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:08.241106 19670 consensus_queue.cc:1035] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:08.249574 19701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.246804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36587 (local address 127.10.249.131:35425)
0810 04:12:08.247118 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.247127 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.247177 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.247287 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.247288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.247289 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:12:08.247338 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.247339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.248103 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.248104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.248797 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.248800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.249244 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.249244 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.249284 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.249294 (+ 10us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.249453 (+ 159us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.249454 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.249481 (+ 27us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.249509 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":249,"threads_started":1}
I20260810 04:12:08.249567 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.246863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:35425 (local address 127.10.249.129:36587)
0810 04:12:08.246922 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.246924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.247178 (+ 254us) server_negotiation.cc:407] Connection header received
0810 04:12:08.247217 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.247218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.247228 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.247287 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:08.247373 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.248037 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.248889 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.249146 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.249179 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.249364 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.249397 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.249455 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.249486 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.249505 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:12:08.256108 19101 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:08.256219 19101 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:08.256887 19101 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: Sending DeleteTablet for 3 replicas of tablet ea07d5dde81d4e1e8d4020cfbe6f7478
I20260810 04:12:08.257125 19542 tablet_service.cc:1514] Processing DeleteTablet for tablet ea07d5dde81d4e1e8d4020cfbe6f7478 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:36258
I20260810 04:12:08.257223 19664 tablet_replica.cc:330] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: stopping tablet replica
I20260810 04:12:08.257277 19664 raft_consensus.cc:2229] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:08.257308 19664 raft_consensus.cc:2258] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.257284 19391 tablet_service.cc:1514] Processing DeleteTablet for tablet ea07d5dde81d4e1e8d4020cfbe6f7478 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:34996
I20260810 04:12:08.257424 19663 tablet_replica.cc:330] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: stopping tablet replica
I20260810 04:12:08.257475 19663 raft_consensus.cc:2229] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:08.257506 19663 raft_consensus.cc:2258] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.260742 19245 tablet_service.cc:1514] Processing DeleteTablet for tablet ea07d5dde81d4e1e8d4020cfbe6f7478 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:60710
I20260810 04:12:08.260845 19662 tablet_replica.cc:330] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: stopping tablet replica
I20260810 04:12:08.260896 19662 raft_consensus.cc:2229] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:12:08.260895 19664 ts_tablet_manager.cc:1905] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:08.260988 19662 raft_consensus.cc:2258] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.261327 19662 ts_tablet_manager.cc:1905] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:08.262647 19664 ts_tablet_manager.cc:1918] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:12:08.262703 19664 log.cc:1196] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/ea07d5dde81d4e1e8d4020cfbe6f7478
I20260810 04:12:08.262899 19664 ts_tablet_manager.cc:1939] T ea07d5dde81d4e1e8d4020cfbe6f7478 P d0c7fe9473b743738bbb6661884b09fb: Deleting consensus metadata
I20260810 04:12:08.263046 19662 ts_tablet_manager.cc:1918] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:12:08.263093 19662 log.cc:1196] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/ea07d5dde81d4e1e8d4020cfbe6f7478
I20260810 04:12:08.263303 19662 ts_tablet_manager.cc:1939] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 5b16de532d0741b6989d06266186a2d6: Deleting consensus metadata
I20260810 04:12:08.263301 19089 catalog_manager.cc:4841] TS d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963): tablet ea07d5dde81d4e1e8d4020cfbe6f7478 (table test-table [id=e4e6d522328043d8b5700df25ca15d7d]) successfully deleted
I20260810 04:12:08.263507 19663 ts_tablet_manager.cc:1905] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:08.263731 19088 catalog_manager.cc:4841] TS 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587): tablet ea07d5dde81d4e1e8d4020cfbe6f7478 (table test-table [id=e4e6d522328043d8b5700df25ca15d7d]) successfully deleted
I20260810 04:12:08.264988 19663 ts_tablet_manager.cc:1918] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:12:08.265048 19663 log.cc:1196] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/ea07d5dde81d4e1e8d4020cfbe6f7478
I20260810 04:12:08.265286 19663 ts_tablet_manager.cc:1939] T ea07d5dde81d4e1e8d4020cfbe6f7478 P 93243ab619944f05aaca800579cda471: Deleting consensus metadata
I20260810 04:12:08.265774 19089 catalog_manager.cc:4841] TS 93243ab619944f05aaca800579cda471 (127.10.249.130:46853): tablet ea07d5dde81d4e1e8d4020cfbe6f7478 (table test-table [id=e4e6d522328043d8b5700df25ca15d7d]) successfully deleted
Aug 10 04:12:08 dist-test-slave-0kls krb5kdc[19057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:12:08 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:08 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 04:12:08.292245 19678 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:08.285073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60880 (local address 127.10.249.190:38453)
0810 04:12:08.285131 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.285134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.285323 (+ 189us) server_negotiation.cc:407] Connection header received
0810 04:12:08.285364 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.285365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.285379 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.285447 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:08.286194 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.286949 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.288023 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.288340 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.288414 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.292174 (+ 3760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60880: BlockingRecv error: recv got EOF from 127.0.0.1:60880 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 10 04:12:08 dist-test-slave-0kls krb5kdc[19057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM
I20260810 04:12:08.302124 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.292989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60896 (local address 127.10.249.190:38453)
0810 04:12:08.293029 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.293031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.293319 (+ 288us) server_negotiation.cc:407] Connection header received
0810 04:12:08.293355 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.293355 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.293368 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.293438 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:08.294031 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.294726 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.295686 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.295976 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.296056 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.298926 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:08.298928 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:08.298928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:08.298936 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:08.300875 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:08.301317 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:08.301318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:08.301319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:08.301375 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:08.301617 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:08.301619 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:08.301619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:08.301747 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:08.301882 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.301974 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.302045 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:12:08.303710 19101 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:12:08.303900 19101 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:12:08.305466 19542 tablet_service.cc:1467] Processing CreateTablet for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b (DEFAULT_TABLE table=test-table [id=6aec9e84f5ab49778e1f46dc6a52616a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:08.305534 19245 tablet_service.cc:1467] Processing CreateTablet for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b (DEFAULT_TABLE table=test-table [id=6aec9e84f5ab49778e1f46dc6a52616a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:08.305631 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.305668 19245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.307049 19638 tablet_bootstrap.cc:492] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: Bootstrap starting.
I20260810 04:12:08.307121 19391 tablet_service.cc:1467] Processing CreateTablet for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b (DEFAULT_TABLE table=test-table [id=6aec9e84f5ab49778e1f46dc6a52616a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:08.307243 19391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.307474 19638 tablet_bootstrap.cc:654] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.308570 19639 tablet_bootstrap.cc:492] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: Bootstrap starting.
I20260810 04:12:08.308583 19643 tablet_bootstrap.cc:492] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: Bootstrap starting.
I20260810 04:12:08.308905 19639 tablet_bootstrap.cc:654] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.308995 19643 tablet_bootstrap.cc:654] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.309629 19643 tablet_bootstrap.cc:492] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: No bootstrap required, opened a new log
I20260810 04:12:08.309679 19643 ts_tablet_manager.cc:1397] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:12:08.309872 19643 raft_consensus.cc:348] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.309957 19643 raft_consensus.cc:374] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.309983 19643 raft_consensus.cc:729] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0c7fe9473b743738bbb6661884b09fb, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.310019 19643 consensus_queue.cc:260] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.310137 19643 ts_tablet_manager.cc:1428] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:08.311074 19638 tablet_bootstrap.cc:492] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: No bootstrap required, opened a new log
I20260810 04:12:08.311132 19638 ts_tablet_manager.cc:1397] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 04:12:08.311275 19638 raft_consensus.cc:348] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.311340 19638 raft_consensus.cc:374] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.311362 19638 raft_consensus.cc:729] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b16de532d0741b6989d06266186a2d6, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.311414 19638 consensus_queue.cc:260] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.311511 19638 ts_tablet_manager.cc:1428] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:08.314349 19639 tablet_bootstrap.cc:492] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: No bootstrap required, opened a new log
I20260810 04:12:08.314422 19639 ts_tablet_manager.cc:1397] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260810 04:12:08.314571 19639 raft_consensus.cc:348] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.314643 19639 raft_consensus.cc:374] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.314664 19639 raft_consensus.cc:729] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93243ab619944f05aaca800579cda471, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.314703 19639 consensus_queue.cc:260] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.314790 19639 ts_tablet_manager.cc:1428] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:08.510030 19699 raft_consensus.cc:482] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:12:08.510131 19699 raft_consensus.cc:504] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.510290 19699 leader_election.cc:288] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93243ab619944f05aaca800579cda471 (127.10.249.130:46853), d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963)
I20260810 04:12:08.510520 19412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e7b2ed2a31c4fbba67ae9b254c70c8b" candidate_uuid: "5b16de532d0741b6989d06266186a2d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93243ab619944f05aaca800579cda471" is_pre_election: true
I20260810 04:12:08.510562 19562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e7b2ed2a31c4fbba67ae9b254c70c8b" candidate_uuid: "5b16de532d0741b6989d06266186a2d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0c7fe9473b743738bbb6661884b09fb" is_pre_election: true
I20260810 04:12:08.510644 19412 raft_consensus.cc:2454] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b16de532d0741b6989d06266186a2d6 in term 0.
I20260810 04:12:08.510648 19562 raft_consensus.cc:2454] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b16de532d0741b6989d06266186a2d6 in term 0.
I20260810 04:12:08.510802 19198 leader_election.cc:302] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, 93243ab619944f05aaca800579cda471; no voters:
I20260810 04:12:08.510943 19699 raft_consensus.cc:2781] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:12:08.510985 19699 raft_consensus.cc:482] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:12:08.510998 19699 raft_consensus.cc:3037] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.511686 19699 raft_consensus.cc:504] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.511837 19699 leader_election.cc:288] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [CANDIDATE]: Term 1 election: Requested vote from peers 93243ab619944f05aaca800579cda471 (127.10.249.130:46853), d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963)
I20260810 04:12:08.511992 19412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e7b2ed2a31c4fbba67ae9b254c70c8b" candidate_uuid: "5b16de532d0741b6989d06266186a2d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93243ab619944f05aaca800579cda471"
I20260810 04:12:08.511996 19562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e7b2ed2a31c4fbba67ae9b254c70c8b" candidate_uuid: "5b16de532d0741b6989d06266186a2d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0c7fe9473b743738bbb6661884b09fb"
I20260810 04:12:08.512075 19412 raft_consensus.cc:3037] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.512094 19562 raft_consensus.cc:3037] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.512737 19562 raft_consensus.cc:2454] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b16de532d0741b6989d06266186a2d6 in term 1.
I20260810 04:12:08.512744 19412 raft_consensus.cc:2454] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b16de532d0741b6989d06266186a2d6 in term 1.
I20260810 04:12:08.512910 19198 leader_election.cc:302] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, 93243ab619944f05aaca800579cda471; no voters:
I20260810 04:12:08.513023 19699 raft_consensus.cc:2781] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:08.513079 19699 raft_consensus.cc:686] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 1 LEADER]: Becoming Leader. State: Replica: 5b16de532d0741b6989d06266186a2d6, State: Running, Role: LEADER
I20260810 04:12:08.513166 19699 consensus_queue.cc:237] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.513779 19101 catalog_manager.cc:5495] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b16de532d0741b6989d06266186a2d6 (127.10.249.129). New cstate: current_term: 1 leader_uuid: "5b16de532d0741b6989d06266186a2d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260810 04:12:08.539163 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.536944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60720 (local address 127.10.249.129:36587)
0810 04:12:08.537005 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.537007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.537016 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:08.537041 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.537042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.537053 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.537111 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:08.537245 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.537682 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.538502 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.538695 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.538771 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.538935 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.538961 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.539016 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.539064 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.539087 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:12:08.540078 19562 raft_consensus.cc:1261] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Refusing update from remote peer 5b16de532d0741b6989d06266186a2d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:08.540072 19412 raft_consensus.cc:1261] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Refusing update from remote peer 5b16de532d0741b6989d06266186a2d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:08.540334 19642 consensus_queue.cc:1035] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:08.540434 19699 consensus_queue.cc:1035] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:08.542855 19101 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:08.542958 19101 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:08.543519 19101 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: Sending DeleteTablet for 3 replicas of tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b
I20260810 04:12:08.543745 19391 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:34996
I20260810 04:12:08.543767 19542 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:36258
I20260810 04:12:08.543799 19245 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:60710
I20260810 04:12:08.543833 19663 tablet_replica.cc:330] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: stopping tablet replica
I20260810 04:12:08.543851 19664 tablet_replica.cc:330] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: stopping tablet replica
I20260810 04:12:08.543874 19662 tablet_replica.cc:330] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: stopping tablet replica
I20260810 04:12:08.543882 19663 raft_consensus.cc:2229] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:08.543893 19664 raft_consensus.cc:2229] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:08.543915 19663 raft_consensus.cc:2258] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.543915 19662 raft_consensus.cc:2229] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:12:08.543931 19664 raft_consensus.cc:2258] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.543967 19662 raft_consensus.cc:2258] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.544245 19664 ts_tablet_manager.cc:1905] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:08.544282 19662 ts_tablet_manager.cc:1905] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:08.544225 19101 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:12:08.544354 19101 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:12:08.545575 19245 tablet_service.cc:1467] Processing CreateTablet for tablet 335cab4b3beb4593a0e2585cc7a1d980 (DEFAULT_TABLE table=test-table [id=ffc245cb847f4b0dbeadffa5cd4ddf6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:08.545579 19542 tablet_service.cc:1467] Processing CreateTablet for tablet 335cab4b3beb4593a0e2585cc7a1d980 (DEFAULT_TABLE table=test-table [id=ffc245cb847f4b0dbeadffa5cd4ddf6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:08.545694 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 335cab4b3beb4593a0e2585cc7a1d980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.545703 19245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 335cab4b3beb4593a0e2585cc7a1d980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.546152 19664 ts_tablet_manager.cc:1918] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:12:08.546203 19664 log.cc:1196] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/6e7b2ed2a31c4fbba67ae9b254c70c8b
I20260810 04:12:08.546221 19663 ts_tablet_manager.cc:1905] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:08.546423 19664 ts_tablet_manager.cc:1939] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P d0c7fe9473b743738bbb6661884b09fb: Deleting consensus metadata
I20260810 04:12:08.546612 19391 tablet_service.cc:1467] Processing CreateTablet for tablet 335cab4b3beb4593a0e2585cc7a1d980 (DEFAULT_TABLE table=test-table [id=ffc245cb847f4b0dbeadffa5cd4ddf6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:08.546728 19391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 335cab4b3beb4593a0e2585cc7a1d980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:08.546772 19089 catalog_manager.cc:4841] TS d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963): tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b (table test-table [id=6aec9e84f5ab49778e1f46dc6a52616a]) successfully deleted
I20260810 04:12:08.547636 19663 ts_tablet_manager.cc:1918] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:12:08.547717 19663 log.cc:1196] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/6e7b2ed2a31c4fbba67ae9b254c70c8b
I20260810 04:12:08.547766 19643 tablet_bootstrap.cc:492] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: Bootstrap starting.
I20260810 04:12:08.547972 19663 ts_tablet_manager.cc:1939] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 93243ab619944f05aaca800579cda471: Deleting consensus metadata
I20260810 04:12:08.548048 19639 tablet_bootstrap.cc:492] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: Bootstrap starting.
I20260810 04:12:08.548065 19643 tablet_bootstrap.cc:654] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.548317 19639 tablet_bootstrap.cc:654] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.548612 19643 tablet_bootstrap.cc:492] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: No bootstrap required, opened a new log
I20260810 04:12:08.548626 19089 catalog_manager.cc:4841] TS 93243ab619944f05aaca800579cda471 (127.10.249.130:46853): tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b (table test-table [id=6aec9e84f5ab49778e1f46dc6a52616a]) successfully deleted
I20260810 04:12:08.548653 19643 ts_tablet_manager.cc:1397] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:08.548774 19643 raft_consensus.cc:348] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.548839 19643 raft_consensus.cc:374] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.548849 19639 tablet_bootstrap.cc:492] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: No bootstrap required, opened a new log
I20260810 04:12:08.548859 19643 raft_consensus.cc:729] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0c7fe9473b743738bbb6661884b09fb, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.548885 19639 ts_tablet_manager.cc:1397] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260810 04:12:08.548913 19643 consensus_queue.cc:260] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.549000 19643 ts_tablet_manager.cc:1428] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:08.548976 19639 raft_consensus.cc:348] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.549031 19639 raft_consensus.cc:374] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.549052 19639 raft_consensus.cc:729] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93243ab619944f05aaca800579cda471, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.549093 19639 consensus_queue.cc:260] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.549193 19639 ts_tablet_manager.cc:1428] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:08.549608 19662 ts_tablet_manager.cc:1918] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:12:08.549672 19662 log.cc:1196] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/6e7b2ed2a31c4fbba67ae9b254c70c8b
I20260810 04:12:08.549892 19662 ts_tablet_manager.cc:1939] T 6e7b2ed2a31c4fbba67ae9b254c70c8b P 5b16de532d0741b6989d06266186a2d6: Deleting consensus metadata
I20260810 04:12:08.550184 19088 catalog_manager.cc:4841] TS 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587): tablet 6e7b2ed2a31c4fbba67ae9b254c70c8b (table test-table [id=6aec9e84f5ab49778e1f46dc6a52616a]) successfully deleted
I20260810 04:12:08.550254 19638 tablet_bootstrap.cc:492] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6: Bootstrap starting.
I20260810 04:12:08.550570 19638 tablet_bootstrap.cc:654] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:08.551025 19638 tablet_bootstrap.cc:492] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6: No bootstrap required, opened a new log
I20260810 04:12:08.551082 19638 ts_tablet_manager.cc:1397] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:08.551182 19638 raft_consensus.cc:348] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.551254 19638 raft_consensus.cc:374] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:08.551285 19638 raft_consensus.cc:729] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b16de532d0741b6989d06266186a2d6, State: Initialized, Role: FOLLOWER
I20260810 04:12:08.551333 19638 consensus_queue.cc:260] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.551433 19638 ts_tablet_manager.cc:1428] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:08.631534 19646 raft_consensus.cc:482] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:12:08.631655 19646 raft_consensus.cc:504] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.631865 19646 leader_election.cc:288] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587), 93243ab619944f05aaca800579cda471 (127.10.249.130:46853)
I20260810 04:12:08.632081 19266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "335cab4b3beb4593a0e2585cc7a1d980" candidate_uuid: "d0c7fe9473b743738bbb6661884b09fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b16de532d0741b6989d06266186a2d6" is_pre_election: true
I20260810 04:12:08.632083 19412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "335cab4b3beb4593a0e2585cc7a1d980" candidate_uuid: "d0c7fe9473b743738bbb6661884b09fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93243ab619944f05aaca800579cda471" is_pre_election: true
I20260810 04:12:08.632175 19266 raft_consensus.cc:2454] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0c7fe9473b743738bbb6661884b09fb in term 0.
I20260810 04:12:08.632197 19412 raft_consensus.cc:2454] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0c7fe9473b743738bbb6661884b09fb in term 0.
I20260810 04:12:08.632324 19488 leader_election.cc:302] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, d0c7fe9473b743738bbb6661884b09fb; no voters:
I20260810 04:12:08.632412 19646 raft_consensus.cc:2781] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:12:08.632457 19646 raft_consensus.cc:482] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:12:08.632501 19646 raft_consensus.cc:3037] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.633127 19646 raft_consensus.cc:504] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.633265 19646 leader_election.cc:288] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [CANDIDATE]: Term 1 election: Requested vote from peers 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587), 93243ab619944f05aaca800579cda471 (127.10.249.130:46853)
I20260810 04:12:08.633432 19412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "335cab4b3beb4593a0e2585cc7a1d980" candidate_uuid: "d0c7fe9473b743738bbb6661884b09fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93243ab619944f05aaca800579cda471"
I20260810 04:12:08.633440 19266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "335cab4b3beb4593a0e2585cc7a1d980" candidate_uuid: "d0c7fe9473b743738bbb6661884b09fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b16de532d0741b6989d06266186a2d6"
I20260810 04:12:08.633522 19412 raft_consensus.cc:3037] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.633518 19266 raft_consensus.cc:3037] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:08.634207 19266 raft_consensus.cc:2454] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0c7fe9473b743738bbb6661884b09fb in term 1.
I20260810 04:12:08.634282 19412 raft_consensus.cc:2454] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0c7fe9473b743738bbb6661884b09fb in term 1.
I20260810 04:12:08.634368 19488 leader_election.cc:302] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16de532d0741b6989d06266186a2d6, d0c7fe9473b743738bbb6661884b09fb; no voters:
I20260810 04:12:08.634449 19646 raft_consensus.cc:2781] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:08.634495 19646 raft_consensus.cc:686] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 1 LEADER]: Becoming Leader. State: Replica: d0c7fe9473b743738bbb6661884b09fb, State: Running, Role: LEADER
I20260810 04:12:08.634546 19646 consensus_queue.cc:237] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } }
I20260810 04:12:08.635134 19102 catalog_manager.cc:5495] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb reported cstate change: term changed from 0 to 1, leader changed from <none> to d0c7fe9473b743738bbb6661884b09fb (127.10.249.131). New cstate: current_term: 1 leader_uuid: "d0c7fe9473b743738bbb6661884b09fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0c7fe9473b743738bbb6661884b09fb" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260810 04:12:08.645601 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.643493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36264 (local address 127.10.249.131:45963)
0810 04:12:08.643550 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.643552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.643560 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:12:08.643630 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.643630 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.643640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.643680 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:08.643781 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.644212 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.644935 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.645129 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.645210 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.645360 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.645398 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.645452 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.645512 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.645530 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:12:08.649075 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.647385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:45969 (local address 127.10.249.131:45963)
0810 04:12:08.647416 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:08.647417 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:08.647423 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:12:08.647464 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:08.647465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:08.647470 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:08.647503 (+ 33us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:08.647564 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.648026 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.648624 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.648775 (+ 151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.648816 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.648926 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.648945 (+ 19us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.648974 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:08.649007 (+ 33us) server_negotiation.cc:299] Negotiation successful
0810 04:12:08.649019 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260810 04:12:08.649119 19701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.647336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:45963 (local address 127.10.249.131:45969)
0810 04:12:08.647380 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.647389 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:08.647426 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:08.647506 (+ 80us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:08.647506 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:08.647507 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:12:08.647535 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.647536 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.648091 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.648092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.648562 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:08.648564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:08.648834 (+ 270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:08.648835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:08.648870 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:08.648875 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:12:08.648979 (+ 104us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:12:08.648980 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:12:08.649005 (+ 25us) client_negotiation.cc:240] Negotiation successful
0810 04:12:08.649038 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 04:12:08.650952 19266 raft_consensus.cc:1261] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Refusing update from remote peer d0c7fe9473b743738bbb6661884b09fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:08.651098 19412 raft_consensus.cc:1261] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Refusing update from remote peer d0c7fe9473b743738bbb6661884b09fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:08.651175 19728 consensus_queue.cc:1035] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b16de532d0741b6989d06266186a2d6" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 36587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:08.651263 19646 consensus_queue.cc:1035] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "93243ab619944f05aaca800579cda471" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:08.660776 19102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:08.660878 19102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:08.661557 19102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9efef90b453a4f5399b10cb00125c3a2: Sending DeleteTablet for 3 replicas of tablet 335cab4b3beb4593a0e2585cc7a1d980
I20260810 04:12:08.661757 19245 tablet_service.cc:1514] Processing DeleteTablet for tablet 335cab4b3beb4593a0e2585cc7a1d980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:60710
I20260810 04:12:08.661868 19662 tablet_replica.cc:330] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6: stopping tablet replica
I20260810 04:12:08.661849 19391 tablet_service.cc:1514] Processing DeleteTablet for tablet 335cab4b3beb4593a0e2585cc7a1d980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:34996
I20260810 04:12:08.661913 19662 raft_consensus.cc:2229] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:08.661924 19663 tablet_replica.cc:330] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: stopping tablet replica
I20260810 04:12:08.661948 19662 raft_consensus.cc:2258] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.661965 19663 raft_consensus.cc:2229] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:08.661949 19542 tablet_service.cc:1514] Processing DeleteTablet for tablet 335cab4b3beb4593a0e2585cc7a1d980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:08 UTC) from {username='oryx', principal='oryx/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:36258
I20260810 04:12:08.662000 19663 raft_consensus.cc:2258] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.662032 19664 tablet_replica.cc:330] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: stopping tablet replica
I20260810 04:12:08.662081 19664 raft_consensus.cc:2229] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:12:08.662213 19664 raft_consensus.cc:2258] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:08.662566 19663 ts_tablet_manager.cc:1905] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:08.662592 19664 ts_tablet_manager.cc:1905] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:08.663928 19664 ts_tablet_manager.cc:1918] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:12:08.663937 19663 ts_tablet_manager.cc:1918] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:12:08.663985 19664 log.cc:1196] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/335cab4b3beb4593a0e2585cc7a1d980
I20260810 04:12:08.663998 19663 log.cc:1196] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/335cab4b3beb4593a0e2585cc7a1d980
I20260810 04:12:08.664187 19664 ts_tablet_manager.cc:1939] T 335cab4b3beb4593a0e2585cc7a1d980 P d0c7fe9473b743738bbb6661884b09fb: Deleting consensus metadata
I20260810 04:12:08.664220 19663 ts_tablet_manager.cc:1939] T 335cab4b3beb4593a0e2585cc7a1d980 P 93243ab619944f05aaca800579cda471: Deleting consensus metadata
I20260810 04:12:08.664461 19089 catalog_manager.cc:4841] TS 93243ab619944f05aaca800579cda471 (127.10.249.130:46853): tablet 335cab4b3beb4593a0e2585cc7a1d980 (table test-table [id=ffc245cb847f4b0dbeadffa5cd4ddf6c]) successfully deleted
I20260810 04:12:08.664696 19089 catalog_manager.cc:4841] TS d0c7fe9473b743738bbb6661884b09fb (127.10.249.131:45963): tablet 335cab4b3beb4593a0e2585cc7a1d980 (table test-table [id=ffc245cb847f4b0dbeadffa5cd4ddf6c]) successfully deleted
I20260810 04:12:08.664841 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 19180
I20260810 04:12:08.664917 19662 ts_tablet_manager.cc:1905] T 335cab4b3beb4593a0e2585cc7a1d980 P 5b16de532d0741b6989d06266186a2d6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 04:12:08.673039 19088 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:36587 (error 108)
I20260810 04:12:08.673275 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 19325
I20260810 04:12:08.678287 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:08.678057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:36587 (local address 127.0.0.1:60732)
0810 04:12:08.678203 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:08.678253 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:36587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
W20260810 04:12:08.678424 19088 catalog_manager.cc:4584] TS 5b16de532d0741b6989d06266186a2d6 (127.10.249.129:36587): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 335cab4b3beb4593a0e2585cc7a1d980: Network error: Client connection negotiation failed: client connection to 127.10.249.129:36587: connect: Connection refused (error 111)
I20260810 04:12:08.681398 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 19470
I20260810 04:12:08.688007 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 19071
2026-08-10T04:12:08Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2893 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:12:08 dist-test-slave-0kls krb5kdc[19737](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:12:08 dist-test-slave-0kls krb5kdc[19737](info): set up 2 sockets
Aug 10 04:12:08 dist-test-slave-0kls krb5kdc[19737](info): commencing operation
krb5kdc: starting...
W20260810 04:12:09.692550 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.984s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:12:09 dist-test-slave-0kls krb5kdc[19737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:12:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:12:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:12:09.812608 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:34487
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:34487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:09.893560 19751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:09.893805 19751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:09.893868 19751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:09.894999 19751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:12:09.895071 19751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:09.895093 19751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:09.895123 19751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:12:09.895162 19751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:12:09.896605 19751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:34487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:34487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:09.896854 19751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:09.897079 19751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:09.901898 19759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:09.902021 19751 server_base.cc:1034] running on GCE node
W20260810 04:12:09.901909 19756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:09.901909 19757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:09.902451 19751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:09.902748 19751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:09.903894 19751 hybrid_clock.cc:648] HybridClock initialized: now 1786335129903874 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T04:12:09Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1222 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:12:09 dist-test-slave-0kls krb5kdc[19764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:12:09 dist-test-slave-0kls krb5kdc[19764](info): set up 2 sockets
Aug 10 04:12:09 dist-test-slave-0kls krb5kdc[19764](info): commencing operation
krb5kdc: starting...
W20260810 04:12:10.919665 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.988s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:12:10 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:12:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:12:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:12:11.031993 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37587
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:37587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:11.110212 19777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:11.110440 19777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:11.110474 19777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:11.111557 19777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:12:11.111619 19777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:11.111644 19777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:11.111660 19777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:12:11.111686 19777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:12:11.112946 19777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:37587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:11.113211 19777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:11.113411 19777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:11.117959 19783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:11.117949 19784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.118053 19777 server_base.cc:1034] running on GCE node
W20260810 04:12:11.117947 19786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.118394 19777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:11.118664 19777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:11.119817 19777 hybrid_clock.cc:648] HybridClock initialized: now 1786335131119781 us; error 50 us; skew 500 ppm
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:11.126911 19777 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:12:11.127305 19777 webserver.cc:460] Webserver started at http://127.10.249.190:44021/ using document root <none> and password file <none>
I20260810 04:12:11.127537 19777 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:11.127595 19777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:11.127733 19777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:11.128652 19777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "710e619bc06e482a8435403bb72c8daa"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "54b2bce6cf9bbfaeb3e4a35244111c9c"
server_key_iv: "c75ec241c0019650802bd597bede7efa"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.128973 19777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "710e619bc06e482a8435403bb72c8daa"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "54b2bce6cf9bbfaeb3e4a35244111c9c"
server_key_iv: "c75ec241c0019650802bd597bede7efa"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.130403 19777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:12:11.131209 19793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.131372 19777 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:11.131469 19777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "710e619bc06e482a8435403bb72c8daa"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "54b2bce6cf9bbfaeb3e4a35244111c9c"
server_key_iv: "c75ec241c0019650802bd597bede7efa"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.131537 19777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:11.140717 19777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:11.142797 19777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:11.142961 19777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:11.146548 19777 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:37587
I20260810 04:12:11.146590 19852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:37587 every 8 connection(s)
I20260810 04:12:11.146903 19777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:12:11.147605 19853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:11.149506 19853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Bootstrap starting.
I20260810 04:12:11.150099 19853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:11.150360 19853 log.cc:824] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:11.150992 19853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: No bootstrap required, opened a new log
I20260810 04:12:11.152518 19853 raft_consensus.cc:348] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } }
I20260810 04:12:11.152688 19853 raft_consensus.cc:374] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:11.152750 19853 raft_consensus.cc:729] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 710e619bc06e482a8435403bb72c8daa, State: Initialized, Role: FOLLOWER
I20260810 04:12:11.152920 19853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } }
I20260810 04:12:11.153008 19853 raft_consensus.cc:388] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:12:11.153046 19853 raft_consensus.cc:482] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:12:11.153088 19853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:11.153578 19853 raft_consensus.cc:504] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } }
I20260810 04:12:11.153694 19853 leader_election.cc:302] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 710e619bc06e482a8435403bb72c8daa; no voters:
I20260810 04:12:11.153885 19853 leader_election.cc:288] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:12:11.153934 19856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:11.154155 19856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 1 LEADER]: Becoming Leader. State: Replica: 710e619bc06e482a8435403bb72c8daa, State: Running, Role: LEADER
I20260810 04:12:11.154263 19856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } }
I20260810 04:12:11.154157 19853 sys_catalog.cc:564] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:12:11.154664 19857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "710e619bc06e482a8435403bb72c8daa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } } }
I20260810 04:12:11.154773 19857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:11.154781 19858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 710e619bc06e482a8435403bb72c8daa. Latest consensus state: current_term: 1 leader_uuid: "710e619bc06e482a8435403bb72c8daa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } } }
I20260810 04:12:11.154851 19858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:11.155212 19862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:12:11.155792 19862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:12:11.156693 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 19777
I20260810 04:12:11.156795 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:12:11.156970 11238 external_mini_cluster.cc:1428] Setting key 7e9896cce5b1958499ce89786e3b36b6
I20260810 04:12:11.157361 19862 catalog_manager.cc:1347] Generated new cluster ID: e919aa5c1538486bb4f8eace5f457092
I20260810 04:12:11.157414 19862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:12:11.168007 19876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.157413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58030 (local address 127.10.249.190:37587)
0810 04:12:11.157579 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:11.157588 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:11.158037 (+ 449us) server_negotiation.cc:407] Connection header received
0810 04:12:11.158148 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:11.158154 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:11.158217 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:11.158335 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:11.159059 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.160389 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.161435 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.162026 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.162114 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.164626 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:11.164631 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:11.164631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:11.164641 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:11.166503 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:11.166882 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:11.166885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:11.166885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:11.166982 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:11.167171 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:11.167172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:11.167172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:11.167436 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:11.167578 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:11.167642 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 04:12:11.167774 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":101,"threads_started":1}
I20260810 04:12:11.170542 19862 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:12:11.171028 19862 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:12:11.177629 19862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Generated new TSK 0
I20260810 04:12:11.177811 19862 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:12:11.208201 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37587
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:11.287627 19879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:11.287798 19879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:11.287818 19879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:11.288800 19879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:11.288831 19879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:11.288854 19879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:12:11.290102 19879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:11.290268 19879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:11.290426 19879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:11.294734 19884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:11.294742 19887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.294756 19879 server_base.cc:1034] running on GCE node
W20260810 04:12:11.294765 19885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.295059 19879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:11.295289 19879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:11.296424 19879 hybrid_clock.cc:648] HybridClock initialized: now 1786335131296412 us; error 27 us; skew 500 ppm
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:11.298741 19879 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:12:11.299129 19879 webserver.cc:460] Webserver started at http://127.10.249.129:35701/ using document root <none> and password file <none>
I20260810 04:12:11.299345 19879 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:11.299405 19879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:11.299530 19879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:11.300520 19879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "fb37afc9d959445ba506802643dcdd8d"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "fe71b2d3a295fc6b5cf61e9b1ac6b52a"
server_key_iv: "e9921088016953ed45880a275732a077"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.300873 19879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "fb37afc9d959445ba506802643dcdd8d"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "fe71b2d3a295fc6b5cf61e9b1ac6b52a"
server_key_iv: "e9921088016953ed45880a275732a077"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.302106 19879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:12:11.302772 19894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.302942 19879 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:12:11.303031 19879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "fb37afc9d959445ba506802643dcdd8d"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "fe71b2d3a295fc6b5cf61e9b1ac6b52a"
server_key_iv: "e9921088016953ed45880a275732a077"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.303104 19879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:11.312757 19879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:11.314430 19879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:11.314580 19879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:11.314797 19879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:11.315071 19879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:11.315119 19879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.315155 19879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:11.315186 19879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.320746 19879 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:36447
I20260810 04:12:11.320781 20017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:36447 every 8 connection(s)
I20260810 04:12:11.321074 19879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:12:11.323143 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 19879
I20260810 04:12:11.323252 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:12:11.323423 11238 external_mini_cluster.cc:1428] Setting key d45b98f988bfd64176dc34b130ec9f00
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:12:11.330003 19876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.321721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:44231 (local address 127.10.249.190:37587)
0810 04:12:11.321774 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:11.321775 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:11.321998 (+ 223us) server_negotiation.cc:407] Connection header received
0810 04:12:11.322448 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:11.322449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:11.322461 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:11.322506 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:11.323341 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.323856 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.324707 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.324888 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.324954 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.327091 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:11.327092 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:11.327092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:11.327098 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:11.328578 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:11.328962 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:11.328963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:11.328964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:11.329023 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:11.329231 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:11.329233 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:11.329233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:11.329371 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:11.329458 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:11.329778 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 04:12:11.329895 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:12:11.330135 20020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.321684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:44231)
0810 04:12:11.321861 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:11.321914 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:11.322373 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:11.322558 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:11.322561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:11.323048 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:11.323259 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.323264 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.323949 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.323951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.324613 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.324615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.324962 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.324963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.325076 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.325520 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:11.325528 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:11.326997 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:11.328681 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:11.328687 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:11.328688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:11.328891 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:11.329087 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:11.329087 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:11.329087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:11.329169 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:11.329452 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:11.329456 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:11.329633 (+ 177us) client_negotiation.cc:769] Sending connection context
0810 04:12:11.329725 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 04:12:11.329898 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":77,"threads_started":1}
I20260810 04:12:11.330735 20018 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37587
I20260810 04:12:11.330845 20018 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:11.331032 20018 heartbeater.cc:511] Master 127.10.249.190:37587 requested a full tablet report, sending...
I20260810 04:12:11.331516 19812 ts_manager.cc:194] Registered new tserver with Master: fb37afc9d959445ba506802643dcdd8d (127.10.249.129:36447)
I20260810 04:12:11.332043 19812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:44231
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:12:11.348459 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37587
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:11.422783 20023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:11.422966 20023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:11.422986 20023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:11.424036 20023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:11.424068 20023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:11.424093 20023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:12:11.425421 20023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:11.425592 20023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:11.425750 20023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:11.430157 20029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:11.430148 20031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.430181 20023 server_base.cc:1034] running on GCE node
W20260810 04:12:11.430157 20028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.430544 20023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:11.430768 20023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:11.431908 20023 hybrid_clock.cc:648] HybridClock initialized: now 1786335131431893 us; error 31 us; skew 500 ppm
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:11.434315 20023 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:12:11.434695 20023 webserver.cc:460] Webserver started at http://127.10.249.130:36647/ using document root <none> and password file <none>
I20260810 04:12:11.434919 20023 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:11.434988 20023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:11.435141 20023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:11.436132 20023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "5e03259f01034e3e8b8a3906818d4760"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "332efd1d9bddf409adf2dadd35cca8a1"
server_key_iv: "06735ceaad90185c410cda5016720c32"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.436504 20023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "5e03259f01034e3e8b8a3906818d4760"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "332efd1d9bddf409adf2dadd35cca8a1"
server_key_iv: "06735ceaad90185c410cda5016720c32"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.437721 20023 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:12:11.438470 20038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.438647 20023 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:11.438745 20023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "5e03259f01034e3e8b8a3906818d4760"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "332efd1d9bddf409adf2dadd35cca8a1"
server_key_iv: "06735ceaad90185c410cda5016720c32"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.438828 20023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:11.449275 20023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:11.451392 20023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:11.451560 20023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:11.451781 20023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:11.452064 20023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:11.452114 20023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.452150 20023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:11.452179 20023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.458200 20023 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:35035
I20260810 04:12:11.458240 20159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:35035 every 8 connection(s)
I20260810 04:12:11.458546 20023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:12:11.463115 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 20023
I20260810 04:12:11.463199 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:12:11.463378 11238 external_mini_cluster.cc:1428] Setting key 1904d737b1f7de2387d8f0f71fe6828b
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:12:11.467882 19876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.459220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:34599 (local address 127.10.249.190:37587)
0810 04:12:11.459262 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:11.459263 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:11.459443 (+ 180us) server_negotiation.cc:407] Connection header received
0810 04:12:11.459907 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:11.459908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:11.459917 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:11.459979 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:11.460842 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.461323 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.462264 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.462427 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.462474 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.464825 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:11.464827 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:11.464827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:11.464833 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:11.466525 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:11.466918 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:11.466919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:11.466919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:11.466989 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:11.467300 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:11.467301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:11.467301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:11.467395 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:11.467442 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:11.467762 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 04:12:11.467823 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260810 04:12:11.468190 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.459176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:34599)
0810 04:12:11.459315 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:11.459352 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:11.459825 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:11.460032 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:11.460036 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:11.460580 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:11.460771 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.460775 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.461395 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.461396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.462198 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.462201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.462494 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.462495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.462590 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.463054 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:11.463062 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:11.464731 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:11.466612 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:11.466617 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:11.466619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:11.466843 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:11.467076 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:11.467077 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:11.467078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:11.467227 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:11.467456 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:11.467461 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:11.467632 (+ 171us) client_negotiation.cc:769] Sending connection context
0810 04:12:11.467743 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 04:12:11.467910 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260810 04:12:11.468703 20160 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37587
I20260810 04:12:11.468833 20160 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:11.469002 20160 heartbeater.cc:511] Master 127.10.249.190:37587 requested a full tablet report, sending...
I20260810 04:12:11.469337 19812 ts_manager.cc:194] Registered new tserver with Master: 5e03259f01034e3e8b8a3906818d4760 (127.10.249.130:35035)
I20260810 04:12:11.469664 19812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:34599
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:12:11.486726 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37587
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:11.562160 20165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:11.562351 20165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:11.562386 20165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:11.563349 20165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:11.563405 20165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:11.563442 20165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:12:11.564663 20165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:11.564903 20165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:11.565127 20165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:11.569810 20173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:11.569877 20171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.569839 20165 server_base.cc:1034] running on GCE node
W20260810 04:12:11.569821 20170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.570302 20165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:11.570487 20165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:11.571619 20165 hybrid_clock.cc:648] HybridClock initialized: now 1786335131571610 us; error 32 us; skew 500 ppm
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:11.573683 20165 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:12:11.574110 20165 webserver.cc:460] Webserver started at http://127.10.249.131:34305/ using document root <none> and password file <none>
I20260810 04:12:11.574324 20165 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:11.574384 20165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:11.574532 20165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:11.575441 20165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "c6e3df109c3f40d3b8fd1739735d4fb5"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "914df7eb5580844b9aac9d9465ee978a"
server_key_iv: "a5a53d8ddd405f15f4ade2c450e3c690"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.575806 20165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "c6e3df109c3f40d3b8fd1739735d4fb5"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "914df7eb5580844b9aac9d9465ee978a"
server_key_iv: "a5a53d8ddd405f15f4ade2c450e3c690"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.577054 20165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:12:11.577659 20180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.577854 20165 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:12:11.577946 20165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "c6e3df109c3f40d3b8fd1739735d4fb5"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "914df7eb5580844b9aac9d9465ee978a"
server_key_iv: "a5a53d8ddd405f15f4ade2c450e3c690"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.578023 20165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:11.602653 20165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:11.604290 20165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:11.604455 20165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:11.604699 20165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:11.604996 20165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:11.605046 20165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.605083 20165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:11.605108 20165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.610827 20165 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:34161
I20260810 04:12:11.610873 20298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:34161 every 8 connection(s)
I20260810 04:12:11.611153 20165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:12:11.619516 19876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.611831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:56915 (local address 127.10.249.190:37587)
0810 04:12:11.611900 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:11.611901 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:11.612060 (+ 159us) server_negotiation.cc:407] Connection header received
0810 04:12:11.612519 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:11.612521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:11.612530 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:11.612581 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:11.613450 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.613915 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.614756 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.614906 (+ 150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.614949 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.617039 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:11.617041 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:11.617041 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:11.617048 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:11.618339 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:11.618708 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:11.618709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:11.618710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:11.618759 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:11.618983 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:11.618984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:11.618984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:11.619095 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:11.619143 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:11.619387 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 04:12:11.619454 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:12:11.619666 20302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.611779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:56915)
0810 04:12:11.611925 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:11.611963 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:11.612440 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:11.612639 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:11.612642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:11.613204 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:11.613380 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.613385 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.613994 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.613995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.614688 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.614690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.614968 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.614969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.615057 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.615564 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:11.615573 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:11.616953 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:11.618412 (+ 1459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:11.618418 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:11.618420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:11.618632 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:11.618833 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:11.618834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:11.618834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:11.618934 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:11.619148 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:11.619152 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:11.619261 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 04:12:11.619358 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 04:12:11.619476 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
I20260810 04:12:11.620208 20299 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37587
I20260810 04:12:11.620318 20299 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:11.620491 20299 heartbeater.cc:511] Master 127.10.249.190:37587 requested a full tablet report, sending...
I20260810 04:12:11.620879 19812 ts_manager.cc:194] Registered new tserver with Master: c6e3df109c3f40d3b8fd1739735d4fb5 (127.10.249.131:34161)
I20260810 04:12:11.621097 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 20165
I20260810 04:12:11.621233 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:12:11.621385 19812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:56915
I20260810 04:12:11.621443 11238 external_mini_cluster.cc:1428] Setting key bb67ddc17faaae61b086b7be4fc4bda0
I20260810 04:12:11.622241 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab.
Entry for principal oryx/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab.
WARNING: no policy specified for oryx/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab.
Entry for principal oryx/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab.
WARNING: no policy specified for oryx/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab.
Entry for principal oryx/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab.
I20260810 04:12:11.688740 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 19879
I20260810 04:12:11.695127 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 20023
I20260810 04:12:11.700630 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 20165
I20260810 04:12:11.708652 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 19777
I20260810 04:12:11.714138 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37587
--webserver_interface=127.10.249.190
--webserver_port=44021
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:37587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:11.797149 20311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:11.797341 20311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:11.797363 20311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:11.798516 20311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:12:11.798558 20311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:11.798573 20311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:11.798584 20311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:12:11.798636 20311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:12:11.800179 20311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:37587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=44021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:11.800428 20311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:11.800652 20311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:11.805189 20317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:11.805189 20319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:11.805243 20316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.805371 20311 server_base.cc:1034] running on GCE node
I20260810 04:12:11.805619 20311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:11.805929 20311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:11.807068 20311 hybrid_clock.cc:648] HybridClock initialized: now 1786335131807058 us; error 28 us; skew 500 ppm
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:11.809446 20311 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:12:11.809935 20311 webserver.cc:460] Webserver started at http://127.10.249.190:44021/ using document root <none> and password file <none>
I20260810 04:12:11.810119 20311 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:11.810171 20311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:11.811354 20311 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:12:11.811916 20328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.812070 20311 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:12:11.812139 20311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "710e619bc06e482a8435403bb72c8daa"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "54b2bce6cf9bbfaeb3e4a35244111c9c"
server_key_iv: "c75ec241c0019650802bd597bede7efa"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.812392 20311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:11.829468 20311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:11.831372 20311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:11.831485 20311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:11.835774 20311 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:37587
I20260810 04:12:11.835829 20382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:37587 every 8 connection(s)
I20260810 04:12:11.836197 20311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:12:11.837707 20383 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:12:11.838428 20383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Bootstrap starting.
I20260810 04:12:11.838838 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 20311
I20260810 04:12:11.839164 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:36447
--local_ip_for_outbound_sockets=127.10.249.129
--tserver_master_addrs=127.10.249.190:37587
--webserver_port=35701
--webserver_interface=127.10.249.129
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.249.129
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:12:11.847647 20383 log.cc:824] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:11.849406 20383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:12:11.849723 20383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Bootstrap complete.
I20260810 04:12:11.852109 20383 raft_consensus.cc:348] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } }
I20260810 04:12:11.852348 20383 raft_consensus.cc:729] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 710e619bc06e482a8435403bb72c8daa, State: Initialized, Role: FOLLOWER
I20260810 04:12:11.852516 20383 consensus_queue.cc:260] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } }
I20260810 04:12:11.852588 20383 raft_consensus.cc:388] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:12:11.852656 20383 raft_consensus.cc:482] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:12:11.852701 20383 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:12:11.853718 20383 raft_consensus.cc:504] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } }
I20260810 04:12:11.853856 20383 leader_election.cc:302] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 710e619bc06e482a8435403bb72c8daa; no voters:
I20260810 04:12:11.854074 20383 leader_election.cc:288] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 04:12:11.854115 20388 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:12:11.854254 20388 raft_consensus.cc:686] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [term 2 LEADER]: Becoming Leader. State: Replica: 710e619bc06e482a8435403bb72c8daa, State: Running, Role: LEADER
I20260810 04:12:11.854351 20388 consensus_queue.cc:237] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } }
I20260810 04:12:11.854426 20383 sys_catalog.cc:564] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:12:11.854629 20389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "710e619bc06e482a8435403bb72c8daa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } } }
I20260810 04:12:11.854628 20388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 710e619bc06e482a8435403bb72c8daa. Latest consensus state: current_term: 2 leader_uuid: "710e619bc06e482a8435403bb72c8daa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "710e619bc06e482a8435403bb72c8daa" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37587 } } }
I20260810 04:12:11.854799 20389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:11.854816 20388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:11.855705 20395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:12:11.856241 20395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:12:11.856375 20395 catalog_manager.cc:1259] Loaded cluster ID: e919aa5c1538486bb4f8eace5f457092
I20260810 04:12:11.856410 20395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:12:11.857574 20395 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:12:11.857744 20395 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 710e619bc06e482a8435403bb72c8daa: Loaded TSK: 0
I20260810 04:12:11.857973 20395 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:12:11.923101 20386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:11.923316 20386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:11.923337 20386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:11.924422 20386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:11.924464 20386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:11.924489 20386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:12:11.926055 20386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.129.keytab
--principal=oryx/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:36447
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=35701
--tserver_master_addrs=127.10.249.190:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:11.926280 20386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:11.926530 20386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:11.931681 20412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:11.931735 20411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:11.931690 20414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:11.931905 20386 server_base.cc:1034] running on GCE node
I20260810 04:12:11.932123 20386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:11.932369 20386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:11.933513 20386 hybrid_clock.cc:648] HybridClock initialized: now 1786335131933497 us; error 33 us; skew 500 ppm
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335131, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:11.935880 20386 init.cc:377] Logged in from keytab as oryx/127.10.249.129@KRBTEST.COM (short username oryx)
I20260810 04:12:11.936367 20386 webserver.cc:460] Webserver started at http://127.10.249.129:35701/ using document root <none> and password file <none>
I20260810 04:12:11.936610 20386 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:11.936668 20386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:11.938024 20386 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:11.938632 20422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.938776 20386 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:11.938889 20386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "fb37afc9d959445ba506802643dcdd8d"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "fe71b2d3a295fc6b5cf61e9b1ac6b52a"
server_key_iv: "e9921088016953ed45880a275732a077"
server_key_version: "encryptionkey@0"
I20260810 04:12:11.939185 20386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:11.948268 20386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:11.950385 20386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:11.950521 20386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:11.950764 20386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:11.951112 20386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:11.951150 20386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.951171 20386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:11.951184 20386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:11.958316 20386 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:36447
I20260810 04:12:11.958385 20543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:36447 every 8 connection(s)
I20260810 04:12:11.958688 20386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:12:11.965392 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 20386
I20260810 04:12:11.965729 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:35035
--local_ip_for_outbound_sockets=127.10.249.130
--tserver_master_addrs=127.10.249.190:37587
--webserver_port=36647
--webserver_interface=127.10.249.130
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.249.130
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:11.967927 20546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.959360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:60619)
0810 04:12:11.959529 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:11.959570 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:11.960178 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:11.960580 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:11.960584 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:11.961294 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:11.961541 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.961548 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.962656 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.962657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.963784 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.963787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.964425 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.964426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.964554 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.965011 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:11.965021 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:11.967732 (+ 2711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
W20260810 04:12:11.967981 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:11.959570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:60619 (local address 127.10.249.190:37587)
0810 04:12:11.959735 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:11.959754 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:11.959805 (+ 51us) server_negotiation.cc:407] Connection header received
0810 04:12:11.960352 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:11.960357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:11.960398 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:11.960501 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:11.961647 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.962561 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.963965 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.964334 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.964417 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.967844 (+ 3427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:60619: BlockingRecv error: recv got EOF from 127.10.249.129:60619 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
W20260810 04:12:11.968149 20544 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:37587 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.249.190:37587: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:11.973330 20546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.968388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:35253)
0810 04:12:11.968457 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:11.968467 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:11.968529 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:11.968662 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:11.968662 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:11.968786 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:11.968828 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.968830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.969627 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.969628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.970381 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.970383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.970820 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.970821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.970894 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.971297 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:11.971304 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:11.973245 (+ 1941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260810 04:12:11.973593 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:11.968421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:35253 (local address 127.10.249.190:37587)
0810 04:12:11.968456 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:11.968458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:11.968516 (+ 58us) server_negotiation.cc:407] Connection header received
0810 04:12:11.968581 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:11.968582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:11.968592 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:11.968659 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:11.968901 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.969547 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.970475 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.970743 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.970802 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.973356 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:35253: BlockingRecv error: recv got EOF from 127.10.249.129:35253 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:11 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:11.978456 20546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:11.973578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:47633)
0810 04:12:11.973801 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:11.973811 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:11.973860 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:11.974005 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:11.974006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:11.974118 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:11.974160 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.974161 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.975020 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.975021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.975643 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:11.975645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.976151 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.976152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:11.976201 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.976649 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:11.976655 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:11.978393 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189}
W20260810 04:12:11.978545 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:11.973671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:47633 (local address 127.10.249.190:37587)
0810 04:12:11.973779 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:11.973800 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:11.973872 (+ 72us) server_negotiation.cc:407] Connection header received
0810 04:12:11.973914 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:11.973915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:11.973928 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:11.973976 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:11.974231 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.974928 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.975733 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:11.976055 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:11.976133 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:11.978471 (+ 2338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:47633: BlockingRecv error: recv got EOF from 127.10.249.129:47633 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":74,"threads_started":1}
W20260810 04:12:11.978593 20544 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:12:12.050134 20548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:12.050319 20548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:12.050341 20548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:12.051445 20548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:12.051486 20548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:12.051533 20548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:12:12.052935 20548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.130.keytab
--principal=oryx/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:35035
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=36647
--tserver_master_addrs=127.10.249.190:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:12.053164 20548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:12.053390 20548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:12.058569 20554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:12.058627 20555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:12.058595 20557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:12.058801 20548 server_base.cc:1034] running on GCE node
I20260810 04:12:12.058969 20548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:12.059199 20548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:12.060359 20548 hybrid_clock.cc:648] HybridClock initialized: now 1786335132060339 us; error 32 us; skew 500 ppm
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335132, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:12.062737 20548 init.cc:377] Logged in from keytab as oryx/127.10.249.130@KRBTEST.COM (short username oryx)
I20260810 04:12:12.063151 20548 webserver.cc:460] Webserver started at http://127.10.249.130:36647/ using document root <none> and password file <none>
I20260810 04:12:12.063355 20548 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:12.063431 20548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:12.064666 20548 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:12.065191 20564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:12.065454 20548 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:12.065574 20548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "5e03259f01034e3e8b8a3906818d4760"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "332efd1d9bddf409adf2dadd35cca8a1"
server_key_iv: "06735ceaad90185c410cda5016720c32"
server_key_version: "encryptionkey@0"
I20260810 04:12:12.065944 20548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:12.088563 20548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:12.090845 20548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:12.090998 20548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:12.091251 20548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:12.091550 20548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:12.091605 20548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:12.091643 20548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:12.091670 20548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:12.097150 20548 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:35035
I20260810 04:12:12.097190 20683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:35035 every 8 connection(s)
I20260810 04:12:12.097527 20548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:12:12.102063 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 20548
I20260810 04:12:12.102381 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:34161
--local_ip_for_outbound_sockets=127.10.249.131
--tserver_master_addrs=127.10.249.190:37587
--webserver_port=34305
--webserver_interface=127.10.249.131
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.249.131
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 04:12:12.105038 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:12.098282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:33727 (local address 127.10.249.190:37587)
0810 04:12:12.098369 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:12.098372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:12.098565 (+ 193us) server_negotiation.cc:407] Connection header received
0810 04:12:12.099015 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:12.099016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:12.099031 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:12.099078 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:12.099971 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.100452 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.101407 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.101585 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.101635 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.104991 (+ 3356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:33727: BlockingRecv error: recv got EOF from 127.10.249.130:33727 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:12:12.105126 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:12.098244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:33727)
0810 04:12:12.098438 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:12.098474 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:12.098934 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:12.099138 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:12.099141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:12.099696 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:12.099897 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.099901 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.100531 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.100531 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.101323 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.101325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.101664 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.101665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.101774 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.102363 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:12.102371 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:12.104906 (+ 2535us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":97,"threads_started":1}
W20260810 04:12:12.105351 20685 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:37587 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.249.190:37587: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:12.109967 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:12.105569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:56815)
0810 04:12:12.105619 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:12.105631 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:12.105669 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:12.105862 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:12.105863 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:12.105988 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:12.106030 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.106031 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.106671 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.106672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.107164 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.107166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.107524 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.107525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.107589 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.108011 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:12.108039 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:12.109891 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:12:12.110023 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:12.105645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:56815 (local address 127.10.249.190:37587)
0810 04:12:12.105706 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:12.105709 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:12.105717 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:12:12.105739 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:12.105739 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:12.105749 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:12.105855 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:12.106126 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.106580 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.107258 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.107454 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.107526 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.109960 (+ 2434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:56815: BlockingRecv error: recv got EOF from 127.10.249.130:56815 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:12.114703 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:12.110281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:46599)
0810 04:12:12.110322 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:12.110332 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:12.110364 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:12.110504 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:12.110505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:12.110603 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:12.110626 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.110627 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.111521 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.111522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.111976 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.111977 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.112468 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.112468 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.112501 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.112872 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:12.112876 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:12.114640 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 04:12:12.114858 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:12.110316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:46599 (local address 127.10.249.190:37587)
0810 04:12:12.110364 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:12.110366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:12.110405 (+ 39us) server_negotiation.cc:407] Connection header received
0810 04:12:12.110427 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:12.110428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:12.110439 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:12.110495 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:12.110699 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.111447 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.112049 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.112391 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.112456 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.114722 (+ 2266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:46599: BlockingRecv error: recv got EOF from 127.10.249.130:46599 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:12:12.114872 20685 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:12:12.184146 20688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:12.184360 20688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:12.184399 20688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:12.185413 20688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:12.185472 20688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:12.185509 20688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:12:12.186996 20688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/krb5kdc/oryx_127.10.249.131.keytab
--principal=oryx/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:34161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=34305
--tserver_master_addrs=127.10.249.190:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:12.187235 20688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:12.187430 20688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:12.192044 20693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:12.192049 20688 server_base.cc:1034] running on GCE node
W20260810 04:12:12.192013 20696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:12.192025 20694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:12.192436 20688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:12.192624 20688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:12.193846 20688 hybrid_clock.cc:648] HybridClock initialized: now 1786335132193826 us; error 32 us; skew 500 ppm
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335132, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:12.196026 20688 init.cc:377] Logged in from keytab as oryx/127.10.249.131@KRBTEST.COM (short username oryx)
I20260810 04:12:12.196448 20688 webserver.cc:460] Webserver started at http://127.10.249.131:34305/ using document root <none> and password file <none>
I20260810 04:12:12.196630 20688 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:12.196689 20688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:12.197918 20688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:12.198434 20703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:12.198607 20688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:12.198704 20688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "c6e3df109c3f40d3b8fd1739735d4fb5"
format_stamp: "Formatted at 2026-08-10 04:12:11 on dist-test-slave-0kls"
server_key: "914df7eb5580844b9aac9d9465ee978a"
server_key_iv: "a5a53d8ddd405f15f4ade2c450e3c690"
server_key_version: "encryptionkey@0"
I20260810 04:12:12.198967 20688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:12.214504 20688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:12.217332 20688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:12.217476 20688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:12.217702 20688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:12.218019 20688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:12.218051 20688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:12.218071 20688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:12.218082 20688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:12.223824 20688 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:34161
I20260810 04:12:12.223906 20823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:34161 every 8 connection(s)
I20260810 04:12:12.224237 20688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:12:12.228349 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 20688
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 04:12:12.231432 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:12.224942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:53867 (local address 127.10.249.190:37587)
0810 04:12:12.225028 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:12.225031 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:12.225221 (+ 190us) server_negotiation.cc:407] Connection header received
0810 04:12:12.225661 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:12.225662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:12.225672 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:12.225724 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:12.226681 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.227153 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.228063 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.228338 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.228412 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.231379 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:53867: BlockingRecv error: recv got EOF from 127.10.249.131:53867 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 04:12:12.231490 20826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:12.224913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:53867)
0810 04:12:12.225090 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:12.225125 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:12.225581 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:12.225776 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:12.225832 (+ 56us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:12.226413 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:12.226600 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.226605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.227231 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.227232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.227988 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.227989 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.228457 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.228458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.228643 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.229224 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:12.229233 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:12.231318 (+ 2085us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
W20260810 04:12:12.231861 20824 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:37587 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.249.190:37587: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:12.235224 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:12.228955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58042 (local address 127.10.249.190:37587)
0810 04:12:12.229011 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:12.229013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:12.229022 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:12.229082 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:12.229083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:12.229094 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:12.229160 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:12.229744 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.230255 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.231007 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.231204 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.231274 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.232506 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:12.232510 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:12.232511 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:12.232521 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:12.234009 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:12.234321 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:12.234324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:12.234324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:12.234416 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:12.234602 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:12.234603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:12.234604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:12.234807 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:12.234934 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:12.235039 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 04:12:12.235139 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:12.236177 20826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:12.232109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:40397)
0810 04:12:12.232136 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:12.232145 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:12.232199 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:12.232303 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:12.232304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:12.232420 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:12.232456 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.232458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.233153 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.233154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.233710 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.233712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.234079 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.234079 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.234143 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.234465 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:12.234469 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:12.236111 (+ 1642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":13}
W20260810 04:12:12.236235 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:12.232157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:40397 (local address 127.10.249.190:37587)
0810 04:12:12.232212 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:12.232213 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:12.232221 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:12:12.232241 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:12.232242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:12.232250 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:12.232300 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:12.232534 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.233077 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.233822 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.233997 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.234076 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.236180 (+ 2104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:40397: BlockingRecv error: recv got EOF from 127.10.249.131:40397 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:12.240444 20826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:12.236583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:53649)
0810 04:12:12.236680 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:12.236689 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:12.236746 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:12.236827 (+ 81us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:12.236828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:12.236919 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:12.236941 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.236941 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.237433 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.237433 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.237977 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.237978 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.238278 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.238278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.238343 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.238646 (+ 303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:12.238653 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:12.240407 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260810 04:12:12.240533 20547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:12.236640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:53649 (local address 127.10.249.190:37587)
0810 04:12:12.236695 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:12.236697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:12.236724 (+ 27us) server_negotiation.cc:407] Connection header received
0810 04:12:12.236778 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:12.236778 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:12.236784 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:12.236825 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:12.236996 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.237373 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.238054 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.238216 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.238266 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.240479 (+ 2213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:53649: BlockingRecv error: recv got EOF from 127.10.249.131:53649 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 04:12:12.240638 20824 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:12 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:12.983583 20828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:12.979050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:43865)
0810 04:12:12.979191 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:12.979202 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:12.979256 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:12.979393 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:12.979394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:12.979541 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:12.979590 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.979592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.980232 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.980233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.980846 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:12.980867 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.981304 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.981305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:12.981373 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.981845 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:12.981850 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:12.983486 (+ 1636us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
W20260810 04:12:12.983624 20829 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:12.979137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:43865 (local address 127.10.249.190:37587)
0810 04:12:12.979277 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:12.979279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:12.979286 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:12:12.979306 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:12.979306 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:12.979316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:12.979376 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:12.979660 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.980166 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.980962 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:12.981201 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:12.981281 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:12.983556 (+ 2275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:43865: BlockingRecv error: recv got EOF from 127.10.249.129:43865 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
Aug 10 04:12:13 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:13 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:13.119998 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:13.115239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:41993)
0810 04:12:13.115404 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:13.115432 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:13.115516 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:13.115699 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:13.115700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:13.115914 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:13.115960 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:13.115962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.116623 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.116624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:13.117164 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:13.117166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.117504 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.117505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:13.117569 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:13.118102 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:13.118108 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:13.119892 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
W20260810 04:12:13.120036 20829 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:13.115312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:41993 (local address 127.10.249.190:37587)
0810 04:12:13.115377 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:13.115380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:13.115496 (+ 116us) server_negotiation.cc:407] Connection header received
0810 04:12:13.115566 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:13.115567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:13.115579 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:13.115687 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:13.116044 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.116530 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.117244 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.117425 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.117503 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:13.119972 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:41993: BlockingRecv error: recv got EOF from 127.10.249.130:41993 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 04:12:13 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:13 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:13.245915 20831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:13.241116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:39641)
0810 04:12:13.241273 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:13.241293 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:13.241363 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:13.241571 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:13.241572 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:13.241861 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:13.241924 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:13.241927 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.242749 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.242750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:13.243287 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:13.243288 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.243624 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.243625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:13.243664 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:13.244105 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:13.244110 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:13.245787 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
W20260810 04:12:13.245952 20829 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:13.241230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:39641 (local address 127.10.249.190:37587)
0810 04:12:13.241294 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:13.241296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:13.241356 (+ 60us) server_negotiation.cc:407] Connection header received
0810 04:12:13.241466 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:13.241467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:13.241488 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:13.241543 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:13.242056 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.242678 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.243376 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.243560 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.243614 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:13.245888 (+ 2274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:39641: BlockingRecv error: recv got EOF from 127.10.249.131:39641 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 04:12:13 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:13 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:13.988617 20832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:13.984194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:60333)
0810 04:12:13.984334 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:13.984344 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:13.984396 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:13.984545 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:13.984546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:13.984707 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:13.984756 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:13.984757 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.985331 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.985331 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:13.985940 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:13.985944 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.986267 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.986268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:13.986308 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:13.986805 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:13.986810 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:13.988560 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
W20260810 04:12:13.988790 20833 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:13.984244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:60333 (local address 127.10.249.190:37587)
0810 04:12:13.984381 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:13.984383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:13.984392 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:13.984453 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:13.984454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:13.984478 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:13.984527 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:13.984817 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.985271 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.986017 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:13.986206 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:13.986255 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:13.988682 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:60333: BlockingRecv error: recv got EOF from 127.10.249.129:60333 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
Aug 10 04:12:14 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:14 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:14.125095 20834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:14.120512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:36619)
0810 04:12:14.120662 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:14.120672 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:14.120730 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:14.120842 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:14.120842 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:14.121018 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:14.121068 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:14.121069 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.121685 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.121686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:14.122241 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:14.122242 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.122624 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.122625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:14.122665 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:14.123197 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:14.123202 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:14.125038 (+ 1836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
W20260810 04:12:14.125239 20833 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:14.120600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:36619 (local address 127.10.249.190:37587)
0810 04:12:14.120678 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:14.120683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:14.120732 (+ 49us) server_negotiation.cc:407] Connection header received
0810 04:12:14.120776 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:14.120777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:14.120787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:14.120836 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:14.121130 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.121616 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.122347 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.122553 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.122613 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:14.125154 (+ 2541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:36619: BlockingRecv error: recv got EOF from 127.10.249.130:36619 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 04:12:14 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:14 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:14.250676 20835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:14.246373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:41981)
0810 04:12:14.246520 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:14.246532 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:14.246600 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:14.246735 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:14.246736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:14.246922 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:14.246970 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:14.246971 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.247528 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.247529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:14.248023 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:14.248025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.248319 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.248320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:14.248356 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:14.248877 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:14.248883 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:14.250615 (+ 1732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
W20260810 04:12:14.250774 20833 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:14.246497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:41981 (local address 127.10.249.190:37587)
0810 04:12:14.246557 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:14.246559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:14.246582 (+ 23us) server_negotiation.cc:407] Connection header received
0810 04:12:14.246651 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:14.246652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:14.246664 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:14.246712 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:14.247020 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.247471 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.248085 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.248260 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.248306 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:14.250706 (+ 2400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:41981: BlockingRecv error: recv got EOF from 127.10.249.131:41981 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 04:12:14 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:14 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:14.993450 20836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:14.989237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:32991)
0810 04:12:14.989368 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:14.989380 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:14.989434 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:14.989585 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:14.989585 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:14.989750 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:14.989843 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:14.989845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.990466 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.990467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:14.990985 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:14.990986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.991320 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.991321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:14.991359 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:14.991789 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:14.991795 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:14.993398 (+ 1603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
W20260810 04:12:14.993578 20837 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:14.989329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:32991 (local address 127.10.249.190:37587)
0810 04:12:14.989470 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:14.989472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:14.989479 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:12:14.989500 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:14.989500 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:14.989509 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:14.989572 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:14.989918 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.990402 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.991078 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:14.991259 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:14.991309 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:14.993477 (+ 2168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:32991: BlockingRecv error: recv got EOF from 127.10.249.129:32991 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
Aug 10 04:12:15 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:15 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:15.130035 20838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:15.125492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:59271)
0810 04:12:15.125653 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:15.125664 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:15.125769 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:15.125967 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:15.125968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:15.126159 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:15.126206 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:15.126207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.126896 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.126897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:15.127374 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:15.127376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.127687 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.127688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:15.127736 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:15.128181 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:15.128186 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:15.129984 (+ 1798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
W20260810 04:12:15.130131 20837 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:15.125563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:59271 (local address 127.10.249.190:37587)
0810 04:12:15.125631 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:15.125633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:15.125751 (+ 118us) server_negotiation.cc:407] Connection header received
0810 04:12:15.125868 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:15.125869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:15.125882 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:15.125956 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:15.126289 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.126787 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.127447 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.127615 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.127689 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:15.130063 (+ 2374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:59271: BlockingRecv error: recv got EOF from 127.10.249.130:59271 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 10 04:12:15 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:15 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:15.256188 20839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:15.251124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:42355)
0810 04:12:15.251290 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:15.251300 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:15.251364 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:15.251542 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:15.251543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:15.251765 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:15.251843 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:15.251845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.252614 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.252615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:15.253142 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:15.253145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.253526 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.253527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:15.253583 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:15.254128 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:15.254133 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:15.256091 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":80,"threads_started":1}
W20260810 04:12:15.256237 20837 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:15.251207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:42355 (local address 127.10.249.190:37587)
0810 04:12:15.251275 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:15.251277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:15.251344 (+ 67us) server_negotiation.cc:407] Connection header received
0810 04:12:15.251433 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:15.251433 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:15.251446 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:15.251531 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:15.251908 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.252531 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.253239 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.253425 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.253527 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:15.256172 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:42355: BlockingRecv error: recv got EOF from 127.10.249.131:42355 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 04:12:15 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:15 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:15.998144 20840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:15.993953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:38227)
0810 04:12:15.994092 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:15.994105 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:15.994169 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:15.994294 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:15.994295 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:15.994439 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:15.994487 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:15.994489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.995128 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.995129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:15.995607 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:15.995608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.995936 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.995937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:15.995977 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:15.996470 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:15.996475 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:15.998091 (+ 1616us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
W20260810 04:12:15.998284 20841 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:15.994013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:38227 (local address 127.10.249.190:37587)
0810 04:12:15.994164 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:15.994165 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:15.994199 (+ 34us) server_negotiation.cc:407] Connection header received
0810 04:12:15.994219 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:15.994220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:15.994230 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:15.994275 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:15.994567 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.995038 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.995675 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:15.995871 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:15.995921 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:15.998209 (+ 2288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:38227: BlockingRecv error: recv got EOF from 127.10.249.129:38227 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":63,"threads_started":1}
Aug 10 04:12:16 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:16 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:16.138087 20842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:16.130585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:41383)
0810 04:12:16.130741 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:16.130751 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:16.130827 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:16.130943 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:16.130944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:16.131111 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:16.131158 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:16.131160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.131756 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.131757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:16.132216 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:16.132218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.132554 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.132555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:16.132610 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:16.136350 (+ 3740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:16.136355 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:16.138035 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
W20260810 04:12:16.138226 20841 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:16.130651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:41383 (local address 127.10.249.190:37587)
0810 04:12:16.130722 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:16.130724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:16.130808 (+ 84us) server_negotiation.cc:407] Connection header received
0810 04:12:16.130875 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:16.130875 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:16.130888 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:16.130928 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:16.131228 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.131682 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.132297 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.132482 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.132546 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:16.138154 (+ 5608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:41383: BlockingRecv error: recv got EOF from 127.10.249.130:41383 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 10 04:12:16 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:16 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:16.261138 20843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:16.256627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:58801)
0810 04:12:16.256806 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:16.256824 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:16.256904 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:16.257075 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:16.257076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:16.257268 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:16.257313 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:16.257315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.257995 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.257997 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:16.258455 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:16.258457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.258848 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.258849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:16.258901 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:16.259348 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:16.259353 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:16.261086 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":102,"threads_started":1}
W20260810 04:12:16.261257 20841 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:16.256717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:58801 (local address 127.10.249.190:37587)
0810 04:12:16.256787 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:16.256790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:16.256884 (+ 94us) server_negotiation.cc:407] Connection header received
0810 04:12:16.256999 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:16.257000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:16.257024 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:16.257070 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:16.257393 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.257918 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.258534 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.258776 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.258846 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:16.261186 (+ 2340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:58801: BlockingRecv error: recv got EOF from 127.10.249.131:58801 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 04:12:16 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:16 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:17.002948 20844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:16.998565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:43713)
0810 04:12:16.998692 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:16.998705 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:16.998757 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:16.998879 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:16.998879 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:16.999033 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:16.999081 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:16.999082 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.999650 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:16.999651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:17.000190 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:17.000192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.000502 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.000503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:17.000543 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:17.001005 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:17.001010 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:17.002873 (+ 1863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":75,"threads_started":1}
W20260810 04:12:17.003063 20845 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:16.998634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:43713 (local address 127.10.249.190:37587)
0810 04:12:16.998753 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:16.998755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:16.998764 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:16.998798 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:16.998798 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:16.998808 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:16.998864 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:16.999135 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:16.999580 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.000256 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.000438 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.000487 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:17.002985 (+ 2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:43713: BlockingRecv error: recv got EOF from 127.10.249.129:43713 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
Aug 10 04:12:17 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:17 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:17.142766 20846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:17.138664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:44611)
0810 04:12:17.138813 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:17.138823 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:17.138867 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:17.138998 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:17.138999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:17.139141 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:17.139188 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:17.139190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.139739 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.139739 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:17.140223 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:17.140225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.140502 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.140503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:17.140537 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:17.141020 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:17.141024 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:17.142717 (+ 1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":64,"threads_started":1}
W20260810 04:12:17.142953 20845 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:17.138779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:44611 (local address 127.10.249.190:37587)
0810 04:12:17.138840 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:17.138842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:17.138853 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:12:17.138919 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:17.138920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:17.138929 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:17.138977 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:17.139242 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.139682 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.140284 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.140446 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.140490 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:17.142891 (+ 2401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:44611: BlockingRecv error: recv got EOF from 127.10.249.130:44611 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 10 04:12:17 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:17 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:17.265702 20847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:17.261547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:35789)
0810 04:12:17.261735 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:17.261748 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:17.261833 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:17.262011 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:17.262012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:17.262250 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:17.262308 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:17.262311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.262931 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.262931 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:17.263388 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:17.263389 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.263664 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.263665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:17.263709 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:17.264097 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:17.264101 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:17.265611 (+ 1510us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":83,"threads_started":1}
W20260810 04:12:17.265751 20845 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:17.261706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:35789 (local address 127.10.249.190:37587)
0810 04:12:17.261763 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:17.261765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:17.261816 (+ 51us) server_negotiation.cc:407] Connection header received
0810 04:12:17.261919 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:17.261920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:17.261932 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:17.261993 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:17.262379 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.262869 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.263449 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:17.263609 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:17.263658 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:17.265691 (+ 2033us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:35789: BlockingRecv error: recv got EOF from 127.10.249.131:35789 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 04:12:18 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:18 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:18.008780 20848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:18.003515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:52107)
0810 04:12:18.003667 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:18.003707 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:18.003766 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:18.004082 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:18.004083 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:18.004265 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:18.004313 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:18.004315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.004960 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.004962 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:18.005454 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:18.005456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.005887 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.005888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:18.005968 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:18.006517 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:18.006523 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:18.008703 (+ 2180us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
W20260810 04:12:18.009076 20849 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:18.003589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:52107 (local address 127.10.249.190:37587)
0810 04:12:18.003959 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:18.003961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:18.003967 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:12:18.003987 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:18.003988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:18.003998 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:18.004072 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:18.004391 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.004881 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.005530 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.005749 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.005885 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:18.008963 (+ 3078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:52107: BlockingRecv error: recv got EOF from 127.10.249.129:52107 (error 108)
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":69,"threads_started":1}
Aug 10 04:12:18 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:18 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:18.147280 20850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:18.143204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:45989)
0810 04:12:18.143354 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:18.143364 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:18.143418 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:18.143516 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:18.143517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:18.143655 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:18.143709 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:18.143710 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.144247 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.144248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:18.144697 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:18.144698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.144967 (+ 269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.144968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:18.145002 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:18.145442 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:18.145447 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:18.147230 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
W20260810 04:12:18.147392 20849 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:18.143250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:45989 (local address 127.10.249.190:37587)
0810 04:12:18.143318 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:18.143320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:18.143420 (+ 100us) server_negotiation.cc:407] Connection header received
0810 04:12:18.143457 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:18.143458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:18.143468 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:18.143504 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:18.143760 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.144187 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.144761 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.144913 (+ 152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.144955 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:18.147306 (+ 2351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:45989: BlockingRecv error: recv got EOF from 127.10.249.130:45989 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 04:12:18 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:18 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:18.270813 20851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:18.266284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:50831)
0810 04:12:18.266431 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:18.266442 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:18.266507 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:18.266628 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:18.266629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:18.266787 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:18.266836 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:18.266837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.267433 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.267433 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:18.268223 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:18.268228 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.268629 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.268630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:18.268677 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:18.269090 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:18.269094 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:18.270762 (+ 1668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
W20260810 04:12:18.270934 20849 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:18.266336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:50831 (local address 127.10.249.190:37587)
0810 04:12:18.266408 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:18.266410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:18.266504 (+ 94us) server_negotiation.cc:407] Connection header received
0810 04:12:18.266549 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:18.266550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:18.266563 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:18.266610 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:18.266895 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.267374 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.268322 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:18.268565 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:18.268616 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:18.270860 (+ 2244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:50831: BlockingRecv error: recv got EOF from 127.10.249.131:50831 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 04:12:19 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:19 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:19.013612 20852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:19.009455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:36819)
0810 04:12:19.009588 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:19.009598 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:19.009648 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:19.009750 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:19.009750 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:19.009968 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:19.010021 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:19.010023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.010630 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.010631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:19.011107 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:19.011109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.011440 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.011441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:19.011478 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:19.011842 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:19.011846 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:19.013518 (+ 1672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
W20260810 04:12:19.013665 20853 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:19.009541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:36819 (local address 127.10.249.190:37587)
0810 04:12:19.009650 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:19.009652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:19.009660 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:12:19.009683 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:19.009683 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:19.009693 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:19.009745 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:19.010085 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.010568 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.011221 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.011383 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.011426 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:19.013595 (+ 2169us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:36819: BlockingRecv error: recv got EOF from 127.10.249.129:36819 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":55,"threads_started":1}
Aug 10 04:12:19 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:19 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:19.152200 20854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:19.147899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:34099)
0810 04:12:19.148045 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:19.148055 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:19.148112 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:19.148239 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:19.148239 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:19.148391 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:19.148439 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:19.148441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.149034 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.149035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:19.149542 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:19.149544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.149860 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.149861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:19.149899 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:19.150525 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:19.150530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:19.152124 (+ 1594us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
W20260810 04:12:19.152297 20853 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:19.147972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:34099 (local address 127.10.249.190:37587)
0810 04:12:19.148046 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:19.148048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:19.148112 (+ 64us) server_negotiation.cc:407] Connection header received
0810 04:12:19.148155 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:19.148155 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:19.148167 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:19.148220 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:19.148496 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.148970 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.149608 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.149808 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.149850 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:19.152210 (+ 2360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:34099: BlockingRecv error: recv got EOF from 127.10.249.130:34099 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 04:12:19 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:19 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:19.275228 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:19.271216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:39427)
0810 04:12:19.271342 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:19.271352 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:19.271404 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:19.271524 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:19.271525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:19.271680 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:19.271728 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:19.271729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.272280 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.272280 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:19.272750 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:19.272751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.273029 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.273030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:19.273067 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:19.273484 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:19.273489 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:19.275155 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":70,"threads_started":1}
W20260810 04:12:19.275287 20853 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:19.271289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:39427 (local address 127.10.249.190:37587)
0810 04:12:19.271349 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:19.271351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:19.271404 (+ 53us) server_negotiation.cc:407] Connection header received
0810 04:12:19.271457 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:19.271458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:19.271470 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:19.271510 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:19.271785 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.272221 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.272813 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:19.272971 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:19.273014 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:19.275245 (+ 2231us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:39427: BlockingRecv error: recv got EOF from 127.10.249.131:39427 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 04:12:20 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:20 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:20.018699 20856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:20.014064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:50105)
0810 04:12:20.014204 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:20.014234 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:20.014298 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:20.014416 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:20.014417 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:20.014567 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:20.014618 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:20.014619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.015249 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.015250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:20.015830 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:20.015833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.016163 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.016164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:20.016238 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:20.016762 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:20.016768 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:20.018622 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
W20260810 04:12:20.018837 20857 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:20.014159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:50105 (local address 127.10.249.190:37587)
0810 04:12:20.014312 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:20.014314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:20.014322 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:12:20.014346 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:20.014347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:20.014357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:20.014412 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:20.014683 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.015190 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.015898 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.016104 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.016161 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:20.018735 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:50105: BlockingRecv error: recv got EOF from 127.10.249.129:50105 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
Aug 10 04:12:20 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:20 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:20.157620 20858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:20.152882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:60909)
0810 04:12:20.152997 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:20.153006 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:20.153058 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:20.153173 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:20.153174 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:20.153360 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:20.153429 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:20.153432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.154244 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.154244 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:20.154794 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:20.154797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.155089 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.155090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:20.155261 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:20.155736 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:20.155741 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:20.157529 (+ 1788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":61,"threads_started":1}
W20260810 04:12:20.157670 20857 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:20.152931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:60909 (local address 127.10.249.190:37587)
0810 04:12:20.153007 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:20.153009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:20.153060 (+ 51us) server_negotiation.cc:407] Connection header received
0810 04:12:20.153113 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:20.153114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:20.153124 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:20.153162 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:20.153497 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.154177 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.154861 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.155037 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.155077 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:20.157608 (+ 2531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:60909: BlockingRecv error: recv got EOF from 127.10.249.130:60909 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 04:12:20 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:20 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:20.279672 20860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:20.275696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:46285)
0810 04:12:20.275824 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:20.275835 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:20.275898 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:20.276021 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:20.276021 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:20.276201 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:20.276250 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:20.276251 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.276850 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.276851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:20.277367 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:20.277368 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.277651 (+ 283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.277652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:20.277687 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:20.278088 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:20.278092 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:20.279612 (+ 1520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
W20260810 04:12:20.279767 20857 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:20.275744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:46285 (local address 127.10.249.190:37587)
0810 04:12:20.275807 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:20.275809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:20.275900 (+ 91us) server_negotiation.cc:407] Connection header received
0810 04:12:20.275940 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:20.275941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:20.275953 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:20.276006 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:20.276307 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.276784 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.277430 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:20.277589 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:20.277633 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:20.279703 (+ 2070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:46285: BlockingRecv error: recv got EOF from 127.10.249.131:46285 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 10 04:12:21 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:21 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:21.023886 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:21.019275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:50403)
0810 04:12:21.019441 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:21.019459 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:21.019509 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:21.019757 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:21.019759 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:21.019960 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:21.020036 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:21.020038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.020759 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.020760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:21.021285 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:21.021286 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.021621 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.021622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:21.021673 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:21.022107 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:21.022112 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:21.023828 (+ 1716us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
W20260810 04:12:21.024021 20862 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:21.019486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:50403 (local address 127.10.249.190:37587)
0810 04:12:21.019623 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:21.019625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:21.019633 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:12:21.019655 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:21.019655 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:21.019666 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:21.019728 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:21.020124 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.020691 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.021353 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.021558 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.021606 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:21.023935 (+ 2329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:50403: BlockingRecv error: recv got EOF from 127.10.249.129:50403 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":70,"threads_started":1}
Aug 10 04:12:21 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:21 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:21.166080 20863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:21.158016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:48925)
0810 04:12:21.158175 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:21.158184 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:21.158265 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:21.158397 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:21.158398 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:21.158579 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:21.158624 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:21.158626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.159295 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.159296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:21.159831 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:21.159833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.160256 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.160257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:21.160319 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:21.164278 (+ 3959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:21.164283 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:21.165987 (+ 1704us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":78,"threads_started":1}
W20260810 04:12:21.166152 20862 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:21.158085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:48925 (local address 127.10.249.190:37587)
0810 04:12:21.158152 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:21.158155 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:21.158248 (+ 93us) server_negotiation.cc:407] Connection header received
0810 04:12:21.158316 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:21.158317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:21.158328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:21.158390 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:21.158716 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.159222 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.159938 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.160194 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.160258 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:21.166065 (+ 5807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:48925: BlockingRecv error: recv got EOF from 127.10.249.130:48925 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 04:12:21 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:21 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:21.284653 20864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:21.280133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:35591)
0810 04:12:21.280305 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:21.280318 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:21.280407 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:21.280569 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:21.280570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:21.280750 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:21.280799 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:21.280800 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.281464 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.281465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:21.282047 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:21.282050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.282393 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.282394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:21.282465 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:21.282927 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:21.282932 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:21.284555 (+ 1623us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
W20260810 04:12:21.284705 20862 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:21.280215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:35591 (local address 127.10.249.190:37587)
0810 04:12:21.280297 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:21.280299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:21.280390 (+ 91us) server_negotiation.cc:407] Connection header received
0810 04:12:21.280464 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:21.280465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:21.280487 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:21.280546 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:21.280879 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.281376 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.282135 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:21.282321 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:21.282394 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:21.284628 (+ 2234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:35591: BlockingRecv error: recv got EOF from 127.10.249.131:35591 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 04:12:22 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:22 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:22.028769 20865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:22.024334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:46561)
0810 04:12:22.024481 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:22.024495 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:22.024546 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:22.024750 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:22.024751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:22.024918 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:22.024972 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:22.024973 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.025591 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.025591 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:22.026129 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:22.026133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.026500 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.026501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:22.026545 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:22.026985 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:22.026990 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:22.028699 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
W20260810 04:12:22.028909 20866 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:22.024456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:46561 (local address 127.10.249.190:37587)
0810 04:12:22.024626 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:22.024628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:22.024636 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:12:22.024658 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:22.024659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:22.024669 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:22.024735 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:22.025037 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.025527 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.026235 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.026429 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.026484 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:22.028796 (+ 2312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:46561: BlockingRecv error: recv got EOF from 127.10.249.129:46561 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":107,"threads_started":1}
Aug 10 04:12:22 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:22 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:22.171013 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:22.166639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:34149)
0810 04:12:22.166826 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:22.166837 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:22.166892 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:22.167027 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:22.167028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:22.167197 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:22.167245 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:22.167247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.167920 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.167921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:22.168438 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:22.168439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.168769 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.168770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:22.168820 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:22.169258 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:22.169262 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:22.170954 (+ 1692us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":120,"threads_started":1}
W20260810 04:12:22.171109 20866 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:22.166734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:34149 (local address 127.10.249.190:37587)
0810 04:12:22.166796 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:22.166797 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:22.166890 (+ 93us) server_negotiation.cc:407] Connection header received
0810 04:12:22.166938 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:22.166938 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:22.166950 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:22.167002 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:22.167305 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.167780 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.168503 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.168697 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.168743 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:22.171043 (+ 2300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:34149: BlockingRecv error: recv got EOF from 127.10.249.130:34149 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 04:12:22 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:22 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:22.289724 20868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:22.285226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:43213)
0810 04:12:22.285404 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:22.285414 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:22.285459 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:22.285670 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:22.285671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:22.285874 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:22.285921 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:22.285923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.286554 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.286555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:22.287064 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:22.287066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.287369 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.287370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:22.287424 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:22.287867 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:22.287871 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:22.289627 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":92,"threads_started":1}
W20260810 04:12:22.289815 20866 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:22.285461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:43213 (local address 127.10.249.190:37587)
0810 04:12:22.285549 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:22.285551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:22.285560 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:22.285589 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:22.285589 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:22.285600 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:22.285651 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:22.285983 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.286490 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.287132 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:22.287305 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:22.287352 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:22.289727 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:43213: BlockingRecv error: recv got EOF from 127.10.249.131:43213 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 10 04:12:23 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:23 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:23.033500 20869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:23.029261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:42981)
0810 04:12:23.029419 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:23.029446 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:23.029504 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:23.029663 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:23.029664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:23.029859 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:23.029908 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:23.029909 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.030525 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.030526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:23.031083 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:23.031086 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.031367 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.031368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:23.031403 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:23.031829 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:23.031834 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:23.033435 (+ 1601us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":102,"threads_started":1}
W20260810 04:12:23.033599 20870 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:23.029329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:42981 (local address 127.10.249.190:37587)
0810 04:12:23.029506 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:23.029508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:23.029546 (+ 38us) server_negotiation.cc:407] Connection header received
0810 04:12:23.029567 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:23.029567 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:23.029579 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:23.029656 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:23.029976 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.030459 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.031150 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.031310 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.031353 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:23.033527 (+ 2174us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:42981: BlockingRecv error: recv got EOF from 127.10.249.129:42981 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
Aug 10 04:12:23 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:23 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:23.175745 20871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:23.171563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:46897)
0810 04:12:23.171738 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:23.171749 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:23.171809 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:23.171939 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:23.171940 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:23.172097 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:23.172145 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:23.172147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.172724 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.172725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:23.173206 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:23.173208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.173494 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.173495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:23.173532 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:23.174050 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:23.174055 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:23.175691 (+ 1636us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":108,"threads_started":1}
W20260810 04:12:23.175851 20870 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:23.171633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:46897 (local address 127.10.249.190:37587)
0810 04:12:23.171701 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:23.171703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:23.171810 (+ 107us) server_negotiation.cc:407] Connection header received
0810 04:12:23.171862 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:23.171863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:23.171886 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:23.171921 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:23.172202 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.172668 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.173271 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.173436 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.173479 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:23.175781 (+ 2302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:46897: BlockingRecv error: recv got EOF from 127.10.249.130:46897 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 04:12:23 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:23 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:23.295078 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:23.290405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:43911)
0810 04:12:23.290674 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:23.290686 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:23.290787 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:23.290925 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:23.290926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:23.291101 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:23.291144 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:23.291146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.291764 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.291766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:23.292301 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:23.292303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.292664 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.292665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:23.292730 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:23.293231 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:23.293237 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:23.294974 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":90,"threads_started":1}
W20260810 04:12:23.295107 20870 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:23.290496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:43911 (local address 127.10.249.190:37587)
0810 04:12:23.290671 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:23.290673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:23.290772 (+ 99us) server_negotiation.cc:407] Connection header received
0810 04:12:23.290855 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:23.290856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:23.290870 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:23.290918 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:23.291224 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.291685 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.292393 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:23.292585 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:23.292661 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:23.295045 (+ 2384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:43911: BlockingRecv error: recv got EOF from 127.10.249.131:43911 (error 108)
Metrics: {"server-negotiator.queue_time_us":146}
Aug 10 04:12:24 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:24 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:24.038369 20873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:24.034039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:52855)
0810 04:12:24.034218 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:24.034228 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:24.034298 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:24.034457 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:24.034458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:24.034636 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:24.034681 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:24.034683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.035311 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.035313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:24.035775 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:24.035776 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.036108 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.036109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:24.036179 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:24.036597 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:24.036601 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:24.038284 (+ 1683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":99,"threads_started":1}
W20260810 04:12:24.038421 20874 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:24.034050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:52855 (local address 127.10.249.190:37587)
0810 04:12:24.034215 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:24.034217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:24.034336 (+ 119us) server_negotiation.cc:407] Connection header received
0810 04:12:24.034360 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:24.034361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:24.034373 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:24.034449 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:24.034758 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.035223 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.035851 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.036030 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.036107 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:24.038354 (+ 2247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:52855: BlockingRecv error: recv got EOF from 127.10.249.129:52855 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
Aug 10 04:12:24 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:24 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:24.180737 20875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:24.176414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:41999)
0810 04:12:24.176583 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:24.176594 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:24.176656 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:24.176797 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:24.176799 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:24.176964 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:24.177011 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:24.177013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.177622 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.177622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:24.178225 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:24.178228 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.178528 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.178529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:24.178568 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:24.178976 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:24.178980 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:24.180663 (+ 1683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
W20260810 04:12:24.180801 20874 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:24.176493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:41999 (local address 127.10.249.190:37587)
0810 04:12:24.176565 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:24.176567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:24.176665 (+ 98us) server_negotiation.cc:407] Connection header received
0810 04:12:24.176715 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:24.176715 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:24.176727 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:24.176777 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:24.177073 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.177563 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.178297 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.178468 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.178515 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:24.180754 (+ 2239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:41999: BlockingRecv error: recv got EOF from 127.10.249.130:41999 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 10 04:12:24 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:24 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:24.299784 20876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:24.295696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:36411)
0810 04:12:24.295822 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:24.295832 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:24.295889 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:24.296000 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:24.296001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:24.296145 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:24.296205 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:24.296206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.296832 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.296832 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:24.297355 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:24.297357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.297664 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.297665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:24.297714 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:24.298123 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:24.298128 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:24.299690 (+ 1562us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
W20260810 04:12:24.299844 20874 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:24.295774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:36411 (local address 127.10.249.190:37587)
0810 04:12:24.295833 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:24.295835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:24.295879 (+ 44us) server_negotiation.cc:407] Connection header received
0810 04:12:24.295938 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:24.295939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:24.295948 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:24.295983 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:24.296265 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.296769 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.297426 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:24.297604 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:24.297656 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:24.299795 (+ 2139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:36411: BlockingRecv error: recv got EOF from 127.10.249.131:36411 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 04:12:25 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:25 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:25.043883 20877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:25.039062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:44013)
0810 04:12:25.039216 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:25.039229 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:25.039291 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:25.039462 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:25.039463 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:25.039625 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:25.039673 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:25.039674 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.040473 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.040475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:25.041045 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:25.041047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.041437 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.041438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:25.041499 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:25.042062 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:25.042068 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:25.043820 (+ 1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
W20260810 04:12:25.043987 20878 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:25.039126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:44013 (local address 127.10.249.190:37587)
0810 04:12:25.039269 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:25.039271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:25.039279 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:12:25.039382 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:25.039383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:25.039395 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:25.039443 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:25.039740 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.040402 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.041126 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.041359 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.041424 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:25.043898 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:44013: BlockingRecv error: recv got EOF from 127.10.249.129:44013 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
Aug 10 04:12:25 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:25 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:25.185149 20879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:25.181194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:51435)
0810 04:12:25.181339 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:25.181349 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:25.181408 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:25.181525 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:25.181526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:25.181681 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:25.181728 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:25.181729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.182409 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.182410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:25.182854 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:25.182856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.183143 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.183149 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:25.183184 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:25.183575 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:25.183579 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:25.185093 (+ 1514us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
W20260810 04:12:25.185245 20878 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:25.181295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:51435 (local address 127.10.249.190:37587)
0810 04:12:25.181351 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:25.181353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:25.181409 (+ 56us) server_negotiation.cc:407] Connection header received
0810 04:12:25.181459 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:25.181460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:25.181470 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:25.181506 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:25.181816 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.182342 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.182933 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.183088 (+ 155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.183131 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:25.185179 (+ 2048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:51435: BlockingRecv error: recv got EOF from 127.10.249.130:51435 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 04:12:25 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:25 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:25.304711 20881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:25.300279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:58101)
0810 04:12:25.300443 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:25.300454 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:25.300511 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:25.300630 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:25.300631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:25.300797 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:25.300845 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:25.300846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.301500 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.301501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:25.302041 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:25.302043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.302363 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.302364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:25.302445 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:25.302873 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:25.302877 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:25.304615 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
W20260810 04:12:25.304765 20878 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:25.300319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:58101 (local address 127.10.249.190:37587)
0810 04:12:25.300383 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:25.300386 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:25.300511 (+ 125us) server_negotiation.cc:407] Connection header received
0810 04:12:25.300553 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:25.300554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:25.300565 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:25.300613 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:25.300903 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.301430 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.302107 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:25.302305 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:25.302352 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:25.304699 (+ 2347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:58101: BlockingRecv error: recv got EOF from 127.10.249.131:58101 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 10 04:12:26 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:26 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:26.049100 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:26.044296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:37685)
0810 04:12:26.044461 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:26.044472 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:26.044529 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:26.044781 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:26.044783 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:26.045004 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:26.045062 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:26.045065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.045709 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.045710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:26.046217 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:26.046219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.046593 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.046594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:26.046653 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:26.047140 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:26.047153 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:26.049009 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":66,"threads_started":1}
W20260810 04:12:26.049155 20883 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:26.044468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:37685 (local address 127.10.249.190:37587)
0810 04:12:26.044624 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:26.044626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:26.044635 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:26.044674 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:26.044674 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:26.044685 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:26.044768 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:26.045144 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.045622 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.046296 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.046518 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.046594 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:26.049088 (+ 2494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:37685: BlockingRecv error: recv got EOF from 127.10.249.129:37685 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":73,"threads_started":1}
Aug 10 04:12:26 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:26 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:26.192859 20884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:26.185610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:48409)
0810 04:12:26.185817 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:26.185831 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:26.185911 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:26.186049 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:26.186050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:26.186215 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:26.186264 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:26.186265 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.186891 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.186892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:26.187397 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:26.187398 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.187710 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.187711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:26.187744 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:26.191130 (+ 3386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:26.191134 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:26.192804 (+ 1670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":71,"threads_started":1}
W20260810 04:12:26.192970 20883 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:26.185663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:48409 (local address 127.10.249.190:37587)
0810 04:12:26.185730 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:26.185732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:26.185909 (+ 177us) server_negotiation.cc:407] Connection header received
0810 04:12:26.185968 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:26.185969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:26.185980 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:26.186026 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:26.186329 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.186822 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.187464 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.187653 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.187695 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:26.192896 (+ 5201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:48409: BlockingRecv error: recv got EOF from 127.10.249.130:48409 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 10 04:12:26 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:26 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.131@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:26.309118 20885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:26.305132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.131:42273)
0810 04:12:26.305259 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:26.305268 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:26.305318 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:26.305431 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:26.305432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:26.305581 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:26.305624 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:26.305626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.306182 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.306182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:26.306674 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:26.306676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.306981 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.306982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:26.307021 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:26.307440 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:26.307445 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:26.309064 (+ 1619us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
W20260810 04:12:26.309233 20883 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:26.305205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:42273 (local address 127.10.249.190:37587)
0810 04:12:26.305246 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:26.305248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:26.305307 (+ 59us) server_negotiation.cc:407] Connection header received
0810 04:12:26.305366 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:26.305367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:26.305377 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:26.305411 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:26.305684 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.306120 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.306745 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:26.306919 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:26.306967 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:26.309160 (+ 2193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.131:42273: BlockingRecv error: recv got EOF from 127.10.249.131:42273 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 10 04:12:27 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:27 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.129@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:27.053836 20886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.049653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.129:42719)
0810 04:12:27.049831 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:27.049842 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:27.049890 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:27.050023 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:27.050024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:27.050195 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:27.050247 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.050248 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.050851 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.050851 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.051297 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.051299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.051570 (+ 271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.051571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.051607 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.052065 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:27.052070 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:27.053719 (+ 1649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":97,"threads_started":1}
W20260810 04:12:27.053861 20887 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:27.049740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:42719 (local address 127.10.249.190:37587)
0810 04:12:27.049864 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:27.049866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:27.049877 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:12:27.049936 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:27.049937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:27.049948 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:27.050005 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:27.050311 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.050790 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.051356 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.051515 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.051556 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.053760 (+ 2204us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.129:42719: BlockingRecv error: recv got EOF from 127.10.249.129:42719 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":74,"threads_started":1}
Aug 10 04:12:27 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:12:27 dist-test-slave-0kls krb5kdc[19764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.249.130@KRBTEST.COM for oryx/127.10.249.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:12:27.197891 20888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.193408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37587 (local address 127.10.249.130:37205)
0810 04:12:27.193625 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:27.193638 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:27.193708 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:27.193849 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:27.193850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:27.194001 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:27.194048 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.194050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.194642 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.194643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.195113 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.195115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.195427 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.195428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.195466 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.195920 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:27.195924 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:27.197764 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.249.190:37587: Server oryx/127.10.249.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":109,"threads_started":1}
W20260810 04:12:27.197985 20887 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:27.193621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:37205 (local address 127.10.249.190:37587)
0810 04:12:27.193687 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:27.193688 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:27.193697 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:27.193768 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:27.193769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:27.193794 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:27.193831 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:27.194110 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.194575 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.195185 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.195361 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.195418 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.197899 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.249.130:37205: BlockingRecv error: recv got EOF from 127.10.249.130:37205 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:12:27.230132 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 20386
I20260810 04:12:27.236581 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 20548
I20260810 04:12:27.241138 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 20688
I20260810 04:12:27.245342 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 20311
2026-08-10T04:12:27Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17333 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T04:12:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:12:27Z Disabled control of system clock
I20260810 04:12:27.273233 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:46099
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:46099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 04:12:27.350289 20892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:27.350476 20892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:27.350495 20892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:27.351553 20892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:12:27.351589 20892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:27.351601 20892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:27.351614 20892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:12:27.351625 20892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:12:27.352855 20892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:46099
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:46099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:27.353024 20892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:27.353223 20892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:27.357991 20900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:27.358027 20897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:27.358057 20892 server_base.cc:1034] running on GCE node
W20260810 04:12:27.358021 20898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:27.358353 20892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:27.358610 20892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:27.359766 20892 hybrid_clock.cc:648] HybridClock initialized: now 1786335147359744 us; error 41 us; skew 500 ppm
I20260810 04:12:27.360980 20892 webserver.cc:460] Webserver started at http://127.10.249.190:43369/ using document root <none> and password file <none>
I20260810 04:12:27.361215 20892 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:27.361263 20892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:27.361423 20892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:27.362458 20892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "cc3a40e3a9244e17bb25577c998e4190"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "21e600fc3911071ac0629dedc40c983e"
server_key_iv: "c15bf002bc828ba463ca399e57c452bd"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.362795 20892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "cc3a40e3a9244e17bb25577c998e4190"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "21e600fc3911071ac0629dedc40c983e"
server_key_iv: "c15bf002bc828ba463ca399e57c452bd"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.363950 20892 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:12:27.364648 20908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.364807 20892 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:12:27.364912 20892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "cc3a40e3a9244e17bb25577c998e4190"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "21e600fc3911071ac0629dedc40c983e"
server_key_iv: "c15bf002bc828ba463ca399e57c452bd"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.364984 20892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:27.382558 20892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:27.382814 20892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:27.382946 20892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:27.386380 20892 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:46099
I20260810 04:12:27.386409 20961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:46099 every 8 connection(s)
I20260810 04:12:27.386745 20892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:12:27.387399 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 20892
I20260810 04:12:27.387493 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:12:27.387565 20962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:27.387722 11238 external_mini_cluster.cc:1428] Setting key 0bcc2ad6133b2d30ea48b7c7ee26b214
I20260810 04:12:27.390828 20962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190: Bootstrap starting.
I20260810 04:12:27.391396 20962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:27.391686 20962 log.cc:824] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:27.392441 20962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190: No bootstrap required, opened a new log
I20260810 04:12:27.392611 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.388217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34948 (local address 127.10.249.190:46099)
0810 04:12:27.388377 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:27.388385 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:27.388413 (+ 28us) server_negotiation.cc:407] Connection header received
0810 04:12:27.388871 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:27.388876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:27.388924 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:27.389017 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:27.389229 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.390010 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.390919 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.391286 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.391361 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.391974 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:27.391979 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:27.391979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:12:27.392152 (+ 173us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:27.392192 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:12:27.392202 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:27.392247 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:27.392334 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 04:12:27.392403 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":68,"threads_started":1}
I20260810 04:12:27.394263 20962 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc3a40e3a9244e17bb25577c998e4190" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46099 } }
I20260810 04:12:27.394408 20962 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:27.394455 20962 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc3a40e3a9244e17bb25577c998e4190, State: Initialized, Role: FOLLOWER
I20260810 04:12:27.394613 20962 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc3a40e3a9244e17bb25577c998e4190" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46099 } }
I20260810 04:12:27.394726 20962 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:12:27.394773 20962 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:12:27.394821 20962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:27.395323 20962 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc3a40e3a9244e17bb25577c998e4190" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46099 } }
I20260810 04:12:27.395440 20962 leader_election.cc:302] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc3a40e3a9244e17bb25577c998e4190; no voters:
I20260810 04:12:27.395623 20962 leader_election.cc:288] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:12:27.395673 20967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:27.395859 20967 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [term 1 LEADER]: Becoming Leader. State: Replica: cc3a40e3a9244e17bb25577c998e4190, State: Running, Role: LEADER
I20260810 04:12:27.395915 20962 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:12:27.396001 20967 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc3a40e3a9244e17bb25577c998e4190" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46099 } }
I20260810 04:12:27.396345 20968 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc3a40e3a9244e17bb25577c998e4190" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc3a40e3a9244e17bb25577c998e4190" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46099 } } }
I20260810 04:12:27.396512 20968 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:27.396373 20969 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc3a40e3a9244e17bb25577c998e4190. Latest consensus state: current_term: 1 leader_uuid: "cc3a40e3a9244e17bb25577c998e4190" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc3a40e3a9244e17bb25577c998e4190" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 46099 } } }
I20260810 04:12:27.396688 20969 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190 [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:27.396799 20976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:12:27.397346 20976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:12:27.398836 20976 catalog_manager.cc:1347] Generated new cluster ID: d72602b6ba53492882da28eb72324d69
I20260810 04:12:27.398891 20976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:12:27.406941 20976 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:12:27.407613 20976 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:12:27.411118 20976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc3a40e3a9244e17bb25577c998e4190: Generated new TSK 0
I20260810 04:12:27.411299 20976 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:12:27.417445 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46099
--builtin_ntp_servers=127.10.249.148:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 04:12:27.501230 20986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:27.501402 20986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:27.501422 20986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:27.502570 20986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:27.502610 20986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:27.502632 20986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:12:27.503859 20986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:27.504079 20986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:27.504369 20986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:27.509999 20992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:27.510007 20995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:27.510186 20986 server_base.cc:1034] running on GCE node
W20260810 04:12:27.510278 20991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:27.510448 20986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:27.510694 20986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:27.511835 20986 hybrid_clock.cc:648] HybridClock initialized: now 1786335147511811 us; error 41 us; skew 500 ppm
I20260810 04:12:27.512915 20986 webserver.cc:460] Webserver started at http://127.10.249.129:35757/ using document root <none> and password file <none>
I20260810 04:12:27.513137 20986 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:27.513206 20986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:27.513327 20986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:27.514343 20986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "0ad5b594ce74405a835582c59ce9e2a7"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "9c545f77bab5baadc5d1029a6cb2ebc5"
server_key_iv: "468c79d0d476f0d1b6768c47ba81a2f6"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.514707 20986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "0ad5b594ce74405a835582c59ce9e2a7"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "9c545f77bab5baadc5d1029a6cb2ebc5"
server_key_iv: "468c79d0d476f0d1b6768c47ba81a2f6"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.515974 20986 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:12:27.516744 21002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.516994 20986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:27.517094 20986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "0ad5b594ce74405a835582c59ce9e2a7"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "9c545f77bab5baadc5d1029a6cb2ebc5"
server_key_iv: "468c79d0d476f0d1b6768c47ba81a2f6"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.517165 20986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:27.527892 20986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:27.528204 20986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:27.528352 20986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:27.528578 20986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:27.528926 20986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:27.528967 20986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.528990 20986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:27.529004 20986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.535432 20986 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:44717
I20260810 04:12:27.535531 21124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:44717 every 8 connection(s)
I20260810 04:12:27.535815 20986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:12:27.540357 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.536530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:46799 (local address 127.10.249.190:46099)
0810 04:12:27.536593 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:27.536595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:27.536840 (+ 245us) server_negotiation.cc:407] Connection header received
0810 04:12:27.537271 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:27.537272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:27.537284 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:27.537332 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:27.537994 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.538423 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.539260 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.539417 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.539461 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.540143 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:27.540145 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:27.540145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:12:27.540149 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:27.540164 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:12:27.540168 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:27.540206 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:27.540272 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 04:12:27.540301 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:12:27.540552 21128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.536516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46099 (local address 127.10.249.129:46799)
0810 04:12:27.536710 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:27.536742 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:27.537188 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:27.537386 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:27.537389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:27.537397 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:27.537927 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.537933 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.538498 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.538499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.539193 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.539195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.539486 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.539487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.539584 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.540026 (+ 442us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:12:27.540027 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:27.540051 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:12:27.540071 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:27.540213 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:27.540215 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:27.540217 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:12:27.540260 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 04:12:27.540332 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":106,"threads_started":1}
I20260810 04:12:27.541136 21126 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46099
I20260810 04:12:27.541236 21126 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:27.541401 21126 heartbeater.cc:511] Master 127.10.249.190:46099 requested a full tablet report, sending...
I20260810 04:12:27.541925 20925 ts_manager.cc:194] Registered new tserver with Master: 0ad5b594ce74405a835582c59ce9e2a7 (127.10.249.129:44717)
I20260810 04:12:27.542459 20925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.129:46799
I20260810 04:12:27.544770 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 20986
I20260810 04:12:27.544840 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:12:27.545037 11238 external_mini_cluster.cc:1428] Setting key b67e755d909f9087effb28b04698c1ef
I20260810 04:12:27.545897 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46099
--builtin_ntp_servers=127.10.249.148:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 04:12:27.622409 21129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:27.622604 21129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:27.622637 21129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:27.623710 21129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:27.623773 21129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:27.623812 21129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:12:27.625017 21129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:27.625268 21129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:27.625532 21129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:27.630225 21135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:27.630234 21138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:27.630234 21136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:27.630472 21129 server_base.cc:1034] running on GCE node
I20260810 04:12:27.630689 21129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:27.630905 21129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:27.632038 21129 hybrid_clock.cc:648] HybridClock initialized: now 1786335147632027 us; error 26 us; skew 500 ppm
I20260810 04:12:27.633272 21129 webserver.cc:460] Webserver started at http://127.10.249.130:44585/ using document root <none> and password file <none>
I20260810 04:12:27.633503 21129 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:27.633574 21129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:27.633719 21129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:27.634756 21129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "f422afe583514839a9c05fcde44435b8"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "05be4c5e23aaeff6d8edca42dde3fa44"
server_key_iv: "132c78d3a57529aa708d43ff9ff84932"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.635094 21129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "f422afe583514839a9c05fcde44435b8"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "05be4c5e23aaeff6d8edca42dde3fa44"
server_key_iv: "132c78d3a57529aa708d43ff9ff84932"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.636317 21129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:12:27.637025 21144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.637199 21129 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:27.637300 21129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "f422afe583514839a9c05fcde44435b8"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "05be4c5e23aaeff6d8edca42dde3fa44"
server_key_iv: "132c78d3a57529aa708d43ff9ff84932"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.637387 21129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:27.651935 21129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:27.652174 21129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:27.652300 21129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:27.652477 21129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:27.652760 21129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:27.652807 21129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.652842 21129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:27.652864 21129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.658300 21129 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:33091
I20260810 04:12:27.658370 21262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:33091 every 8 connection(s)
I20260810 04:12:27.658667 21129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:12:27.660795 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 21129
I20260810 04:12:27.660893 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:12:27.661096 11238 external_mini_cluster.cc:1428] Setting key 2f9466740980c5dcf2c7e068f7c9d06e
I20260810 04:12:27.662082 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46099
--builtin_ntp_servers=127.10.249.148:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 04:12:27.664402 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.659386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:52307 (local address 127.10.249.190:46099)
0810 04:12:27.659446 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:27.659447 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:27.659672 (+ 225us) server_negotiation.cc:407] Connection header received
0810 04:12:27.660150 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:27.660151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:27.660162 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:27.660226 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:27.660991 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.661617 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.662959 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.663146 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.663207 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.664124 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:27.664126 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:27.664126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:12:27.664131 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:27.664148 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:12:27.664153 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:27.664208 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:27.664283 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 04:12:27.664307 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:12:27.664503 21266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.659360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46099 (local address 127.10.249.130:52307)
0810 04:12:27.659524 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:27.659560 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:27.660064 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:27.660275 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:27.660278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:27.660286 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:27.660903 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.660911 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.661686 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.661688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.662877 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.662881 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.663234 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.663235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.663390 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.663994 (+ 604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:12:27.663995 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:27.664020 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:12:27.664040 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:27.664214 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:27.664218 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:27.664220 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:12:27.664268 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 04:12:27.664339 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
I20260810 04:12:27.664924 21263 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46099
I20260810 04:12:27.665016 21263 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:27.665203 21263 heartbeater.cc:511] Master 127.10.249.190:46099 requested a full tablet report, sending...
I20260810 04:12:27.665544 20925 ts_manager.cc:194] Registered new tserver with Master: f422afe583514839a9c05fcde44435b8 (127.10.249.130:33091)
I20260810 04:12:27.666086 20925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.130:52307
W20260810 04:12:27.738924 21267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:27.739096 21267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:27.739114 21267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:27.740185 21267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:27.740223 21267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:27.740248 21267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:12:27.741511 21267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:46099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:27.741670 21267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:27.741899 21267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:12:27.746294 21267 server_base.cc:1034] running on GCE node
W20260810 04:12:27.746259 21274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:27.746253 21276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:27.746270 21273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:27.746747 21267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:27.746979 21267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:27.748137 21267 hybrid_clock.cc:648] HybridClock initialized: now 1786335147748120 us; error 35 us; skew 500 ppm
I20260810 04:12:27.749215 21267 webserver.cc:460] Webserver started at http://127.10.249.131:36643/ using document root <none> and password file <none>
I20260810 04:12:27.749433 21267 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:27.749526 21267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:27.749662 21267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:27.750703 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "75fc98ad5cdb4ce6b7418d7579bf4635"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "6892b9f668c0257557ce80da4af00bd5"
server_key_iv: "528a28f5a2d4f950b0599ff107ad8993"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.751039 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "75fc98ad5cdb4ce6b7418d7579bf4635"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "6892b9f668c0257557ce80da4af00bd5"
server_key_iv: "528a28f5a2d4f950b0599ff107ad8993"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.752135 21267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:12:27.752724 21282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.752866 21267 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:27.752951 21267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "75fc98ad5cdb4ce6b7418d7579bf4635"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "6892b9f668c0257557ce80da4af00bd5"
server_key_iv: "528a28f5a2d4f950b0599ff107ad8993"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.753028 21267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:27.769634 21267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:27.769941 21267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:27.770085 21267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:27.770283 21267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:27.770572 21267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:27.770622 21267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.770651 21267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:27.770676 21267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.776240 21267 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:41471
I20260810 04:12:27.776284 21402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:41471 every 8 connection(s)
I20260810 04:12:27.776544 21267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:12:27.777915 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 21267
I20260810 04:12:27.777999 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:12:27.778162 11238 external_mini_cluster.cc:1428] Setting key 42b893dc42ea0f5f7de4aaf060da21ff
I20260810 04:12:27.781728 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.777223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:46377 (local address 127.10.249.190:46099)
0810 04:12:27.777304 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:27.777307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:27.777510 (+ 203us) server_negotiation.cc:407] Connection header received
0810 04:12:27.778095 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:27.778096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:27.778109 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:27.778154 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:27.778919 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.779428 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.780427 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.780644 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.780736 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.781505 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:27.781506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:27.781507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:12:27.781511 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:27.781524 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:12:27.781528 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:27.781568 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:27.781631 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 04:12:27.781654 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 04:12:27.781924 21405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.777184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:46099 (local address 127.10.249.131:46377)
0810 04:12:27.777401 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:27.777431 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:27.777968 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:27.778220 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:27.778224 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:27.778232 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:27.778839 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.778844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.779519 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.779520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.780321 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:27.780324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:27.780751 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:27.780752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:27.780889 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:27.781369 (+ 480us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:12:27.781369 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:27.781394 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:12:27.781413 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:27.781567 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:27.781572 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:27.781575 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:12:27.781626 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 04:12:27.781712 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":113,"threads_started":1}
I20260810 04:12:27.782302 21403 heartbeater.cc:347] Connected to a master server at 127.10.249.190:46099
I20260810 04:12:27.782373 21403 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:27.782574 21403 heartbeater.cc:511] Master 127.10.249.190:46099 requested a full tablet report, sending...
I20260810 04:12:27.782950 20925 ts_manager.cc:194] Registered new tserver with Master: 75fc98ad5cdb4ce6b7418d7579bf4635 (127.10.249.131:41471)
I20260810 04:12:27.783309 20925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.131:46377
I20260810 04:12:27.789827 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 04:12:27.791463 20965 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:27.791072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34960 (local address 127.10.249.190:46099)
0810 04:12:27.791112 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:27.791114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:27.791248 (+ 134us) server_negotiation.cc:407] Connection header received
0810 04:12:27.791287 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:27.791288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:27.791295 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:27.791329 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:27.791424 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34960: BlockingRecv error: recv got EOF from 127.0.0.1:34960 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:12:27.791536 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 20986
I20260810 04:12:27.800150 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 21129
I20260810 04:12:27.805186 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 21267
I20260810 04:12:27.809355 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 20892
2026-08-10T04:12:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (564 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T04:12:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:12:27Z Disabled control of system clock
I20260810 04:12:27.836113 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37325
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:37325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 04:12:27.912519 21414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:27.912679 21414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:27.912698 21414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:27.913564 21414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:12:27.913594 21414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:27.913605 21414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:27.913615 21414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:12:27.913625 21414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:12:27.914943 21414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:37325
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:27.915141 21414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:27.915383 21414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:27.919884 21421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:27.919986 21414 server_base.cc:1034] running on GCE node
W20260810 04:12:27.919912 21420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:27.920145 21423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:27.920415 21414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:27.920710 21414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:27.921852 21414 hybrid_clock.cc:648] HybridClock initialized: now 1786335147921841 us; error 43 us; skew 500 ppm
I20260810 04:12:27.923360 21414 webserver.cc:460] Webserver started at http://127.10.249.190:39955/ using document root <none> and password file <none>
I20260810 04:12:27.923609 21414 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:27.923672 21414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:27.923800 21414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:27.924710 21414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "1dce3a373ef84ebb853994391036cc6a"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "aa855ec2950cff059d7a9dc54646b99d"
server_key_iv: "ff59682c28cb28954e065f0a7536953d"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.925042 21414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "1dce3a373ef84ebb853994391036cc6a"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "aa855ec2950cff059d7a9dc54646b99d"
server_key_iv: "ff59682c28cb28954e065f0a7536953d"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.926363 21414 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:12:27.927074 21429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:27.927251 21414 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:27.927356 21414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "1dce3a373ef84ebb853994391036cc6a"
format_stamp: "Formatted at 2026-08-10 04:12:27 on dist-test-slave-0kls"
server_key: "aa855ec2950cff059d7a9dc54646b99d"
server_key_iv: "ff59682c28cb28954e065f0a7536953d"
server_key_version: "encryptionkey@0"
I20260810 04:12:27.927444 21414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:27.930519 21414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:27.930773 21414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:27.930924 21414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:27.934526 21414 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:37325
I20260810 04:12:27.934564 21486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:37325 every 8 connection(s)
I20260810 04:12:27.934866 21414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:12:27.935547 21487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:27.938263 21487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a: Bootstrap starting.
I20260810 04:12:27.938786 21487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:27.939085 21487 log.cc:824] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:27.939721 21487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a: No bootstrap required, opened a new log
I20260810 04:12:27.940066 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 21414
I20260810 04:12:27.940146 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:12:27.940332 11238 external_mini_cluster.cc:1428] Setting key 80af74e8bf26d52fb750b7ef6c6c93b7
I20260810 04:12:27.941601 21487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dce3a373ef84ebb853994391036cc6a" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37325 } }
I20260810 04:12:27.941738 21487 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:27.941779 21487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce3a373ef84ebb853994391036cc6a, State: Initialized, Role: FOLLOWER
I20260810 04:12:27.941942 21487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dce3a373ef84ebb853994391036cc6a" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37325 } }
I20260810 04:12:27.942059 21487 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:12:27.942092 21487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:12:27.942137 21487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:27.942621 21487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dce3a373ef84ebb853994391036cc6a" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37325 } }
I20260810 04:12:27.942765 21487 leader_election.cc:302] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1dce3a373ef84ebb853994391036cc6a; no voters:
I20260810 04:12:27.942945 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:27.940813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58642 (local address 127.10.249.190:37325)
0810 04:12:27.941055 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:27.941068 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:27.941091 (+ 23us) server_negotiation.cc:407] Connection header received
0810 04:12:27.941583 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:27.941588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:27.941621 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:27.941750 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:27.942476 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:27.942480 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:27.942480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:12:27.942484 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:27.942528 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:12:27.942537 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:27.942605 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:27.942688 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 04:12:27.942744 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":79,"threads_started":1}
I20260810 04:12:27.942960 21487 leader_election.cc:288] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:12:27.943179 21492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:27.943231 21487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:12:27.943288 21492 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [term 1 LEADER]: Becoming Leader. State: Replica: 1dce3a373ef84ebb853994391036cc6a, State: Running, Role: LEADER
I20260810 04:12:27.943354 21492 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dce3a373ef84ebb853994391036cc6a" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37325 } }
I20260810 04:12:27.943653 21492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dce3a373ef84ebb853994391036cc6a. Latest consensus state: current_term: 1 leader_uuid: "1dce3a373ef84ebb853994391036cc6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dce3a373ef84ebb853994391036cc6a" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37325 } } }
I20260810 04:12:27.943661 21494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1dce3a373ef84ebb853994391036cc6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dce3a373ef84ebb853994391036cc6a" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37325 } } }
I20260810 04:12:27.943748 21492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:27.943760 21494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:27.943936 21501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:12:27.944391 21501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:12:27.945987 21501 catalog_manager.cc:1347] Generated new cluster ID: aafcd108205741398657e1479655ccc9
I20260810 04:12:27.946036 21501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:12:27.961289 21501 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:12:27.961457 21501 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:12:27.972703 21501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1dce3a373ef84ebb853994391036cc6a: Generated new TSK 0
I20260810 04:12:27.972878 21501 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:12:27.977133 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37325
--builtin_ntp_servers=127.10.249.148:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 04:12:28.057299 21511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:28.057485 21511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:28.057507 21511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:28.058656 21511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:28.058696 21511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:28.058720 21511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:12:28.059928 21511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:28.060154 21511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:28.060457 21511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:12:28.064965 21511 server_base.cc:1034] running on GCE node
W20260810 04:12:28.064952 21516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:28.064945 21519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:28.064952 21517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:28.065265 21511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:28.065478 21511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:28.066643 21511 hybrid_clock.cc:648] HybridClock initialized: now 1786335148066626 us; error 25 us; skew 500 ppm
I20260810 04:12:28.067900 21511 webserver.cc:460] Webserver started at http://127.10.249.129:36945/ using document root <none> and password file <none>
I20260810 04:12:28.068132 21511 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:28.068220 21511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:28.068361 21511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:28.069320 21511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "5bb1f0801a1c4979add7e427cc7d4192"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "0ad04becb4bb21d2113ab6658c90040a"
server_key_iv: "593d00b5a336d26f439e9342be099b3b"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.069674 21511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "5bb1f0801a1c4979add7e427cc7d4192"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "0ad04becb4bb21d2113ab6658c90040a"
server_key_iv: "593d00b5a336d26f439e9342be099b3b"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.070900 21511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:12:28.071579 21525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.071743 21511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:12:28.071836 21511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "5bb1f0801a1c4979add7e427cc7d4192"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "0ad04becb4bb21d2113ab6658c90040a"
server_key_iv: "593d00b5a336d26f439e9342be099b3b"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.071950 21511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:28.075220 21511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:28.075452 21511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:28.075584 21511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:28.075774 21511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:28.076082 21511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:28.076134 21511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.076180 21511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:28.076206 21511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.081933 21511 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:41141
I20260810 04:12:28.081976 21645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:41141 every 8 connection(s)
I20260810 04:12:28.082235 21511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:12:28.084796 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:28.082852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:58541 (local address 127.10.249.190:37325)
0810 04:12:28.082889 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:28.082891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:28.083071 (+ 180us) server_negotiation.cc:407] Connection header received
0810 04:12:28.083481 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:28.083482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:28.083490 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:28.083563 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:28.084593 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:28.084594 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:28.084595 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:12:28.084599 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:28.084615 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:12:28.084619 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:28.084666 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:28.084721 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 04:12:28.084736 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260810 04:12:28.084956 21648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:28.082815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37325 (local address 127.10.249.129:58541)
0810 04:12:28.082972 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:28.082999 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:28.083386 (+ 387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:28.083625 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:28.083629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:28.083638 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:28.084462 (+ 824us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:12:28.084462 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:28.084484 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:12:28.084507 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:28.084662 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:28.084666 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:28.084669 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:12:28.084732 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 04:12:28.084783 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
I20260810 04:12:28.085439 21646 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37325
I20260810 04:12:28.085551 21646 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:28.085695 21646 heartbeater.cc:511] Master 127.10.249.190:37325 requested a full tablet report, sending...
I20260810 04:12:28.086228 21448 ts_manager.cc:194] Registered new tserver with Master: 5bb1f0801a1c4979add7e427cc7d4192 (127.10.249.129:41141)
I20260810 04:12:28.092252 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 21511
I20260810 04:12:28.092315 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:12:28.092437 11238 external_mini_cluster.cc:1428] Setting key 20fa61c69e910bf83b109c4fa6ba2e20
I20260810 04:12:28.093243 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37325
--builtin_ntp_servers=127.10.249.148:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 04:12:28.170233 21650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:28.170415 21650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:28.170437 21650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:28.171568 21650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:28.171609 21650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:28.171665 21650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:12:28.173012 21650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:28.173245 21650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:28.173527 21650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:28.178650 21656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:28.178658 21655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:28.178656 21658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:28.178941 21650 server_base.cc:1034] running on GCE node
I20260810 04:12:28.179198 21650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:28.179440 21650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:28.180598 21650 hybrid_clock.cc:648] HybridClock initialized: now 1786335148180585 us; error 25 us; skew 500 ppm
I20260810 04:12:28.181908 21650 webserver.cc:460] Webserver started at http://127.10.249.130:43351/ using document root <none> and password file <none>
I20260810 04:12:28.182147 21650 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:28.182219 21650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:28.182361 21650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:28.183398 21650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "295a89080a4545dc9249d8d32960bd53"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "fb4641409bb673c06e4b75a4a7c0ceea"
server_key_iv: "831e5fe2072701999d0e3f5506a17895"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.183769 21650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "295a89080a4545dc9249d8d32960bd53"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "fb4641409bb673c06e4b75a4a7c0ceea"
server_key_iv: "831e5fe2072701999d0e3f5506a17895"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.185009 21650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:12:28.185665 21664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.185863 21650 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:28.185966 21650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "295a89080a4545dc9249d8d32960bd53"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "fb4641409bb673c06e4b75a4a7c0ceea"
server_key_iv: "831e5fe2072701999d0e3f5506a17895"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.186053 21650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:28.189432 21650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:28.189716 21650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:28.189898 21650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:28.190114 21650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:28.190447 21650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:28.190508 21650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.190548 21650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:28.190575 21650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.196210 21650 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:42417
I20260810 04:12:28.196252 21786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:42417 every 8 connection(s)
I20260810 04:12:28.196540 21650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:12:28.197817 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 21650
I20260810 04:12:28.197922 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:12:28.198099 11238 external_mini_cluster.cc:1428] Setting key d16c6b6ab19c59ea44615f8e8deae4c0
I20260810 04:12:28.199012 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37325
--builtin_ntp_servers=127.10.249.148:46845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 04:12:28.199844 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:28.197265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:37807 (local address 127.10.249.190:37325)
0810 04:12:28.197314 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:28.197317 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:28.197572 (+ 255us) server_negotiation.cc:407] Connection header received
0810 04:12:28.198260 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:28.198261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:28.198267 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:28.198301 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:28.199539 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:28.199541 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:28.199541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:12:28.199546 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:28.199565 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:12:28.199569 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:28.199655 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:28.199704 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 04:12:28.199717 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:12:28.199973 21790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:28.197264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37325 (local address 127.10.249.130:37807)
0810 04:12:28.197455 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:28.197485 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:28.198161 (+ 676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:28.198460 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:28.198463 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:28.198470 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:28.199405 (+ 935us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:12:28.199405 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:28.199430 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:12:28.199455 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:28.199647 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:28.199649 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:28.199651 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:12:28.199708 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 04:12:28.199772 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":94,"threads_started":1}
I20260810 04:12:28.200839 21787 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37325
I20260810 04:12:28.200941 21787 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:28.201084 21787 heartbeater.cc:511] Master 127.10.249.190:37325 requested a full tablet report, sending...
I20260810 04:12:28.201406 21448 ts_manager.cc:194] Registered new tserver with Master: 295a89080a4545dc9249d8d32960bd53 (127.10.249.130:42417)
W20260810 04:12:28.275967 21791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:28.276163 21791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:28.276201 21791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:28.277312 21791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:28.277374 21791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:28.277416 21791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:12:28.278715 21791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:28.278949 21791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:28.279230 21791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:12:28.283813 21791 server_base.cc:1034] running on GCE node
W20260810 04:12:28.283821 21799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:28.283767 21797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:28.283766 21796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:28.284139 21791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:28.284356 21791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:28.285502 21791 hybrid_clock.cc:648] HybridClock initialized: now 1786335148285496 us; error 31 us; skew 500 ppm
I20260810 04:12:28.286669 21791 webserver.cc:460] Webserver started at http://127.10.249.131:42033/ using document root <none> and password file <none>
I20260810 04:12:28.286896 21791 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:28.286966 21791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:28.287117 21791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:28.288074 21791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "d00dccab69a6469089d2298741c19ae4"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "f41728c1ab3a1c69c143dc7375ae0fe3"
server_key_iv: "30385eb9c071800eab5362f3f9f2255c"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.288390 21791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "d00dccab69a6469089d2298741c19ae4"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "f41728c1ab3a1c69c143dc7375ae0fe3"
server_key_iv: "30385eb9c071800eab5362f3f9f2255c"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.289722 21791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:12:28.290396 21805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.290542 21791 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.290630 21791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "d00dccab69a6469089d2298741c19ae4"
format_stamp: "Formatted at 2026-08-10 04:12:28 on dist-test-slave-0kls"
server_key: "f41728c1ab3a1c69c143dc7375ae0fe3"
server_key_iv: "30385eb9c071800eab5362f3f9f2255c"
server_key_version: "encryptionkey@0"
I20260810 04:12:28.290723 21791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:28.293550 21791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:28.293766 21791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:28.293907 21791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:28.294094 21791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:28.294371 21791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:28.294420 21791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.294456 21791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:28.294480 21791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:28.299824 21791 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:35447
I20260810 04:12:28.299873 21927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:35447 every 8 connection(s)
I20260810 04:12:28.300163 21791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:12:28.302543 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:28.300746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:48621 (local address 127.10.249.190:37325)
0810 04:12:28.300805 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:28.300808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:28.301038 (+ 230us) server_negotiation.cc:407] Connection header received
0810 04:12:28.301379 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:28.301380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:28.301385 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:28.301429 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:28.302379 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:28.302380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:28.302380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:12:28.302384 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:28.302397 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:12:28.302401 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:28.302439 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:28.302487 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 04:12:28.302498 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:12:28.302719 21930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:28.300741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37325 (local address 127.10.249.131:48621)
0810 04:12:28.300912 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:28.300957 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:28.301304 (+ 347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:28.301477 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:28.301480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:28.301487 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:28.302254 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:12:28.302255 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:28.302278 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:12:28.302301 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:28.302442 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:28.302444 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:28.302446 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:12:28.302484 (+ 38us) client_negotiation.cc:240] Negotiation successful
0810 04:12:28.302523 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260810 04:12:28.303129 21928 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37325
I20260810 04:12:28.303224 21928 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:28.303359 21928 heartbeater.cc:511] Master 127.10.249.190:37325 requested a full tablet report, sending...
I20260810 04:12:28.303702 21448 ts_manager.cc:194] Registered new tserver with Master: d00dccab69a6469089d2298741c19ae4 (127.10.249.131:35447)
I20260810 04:12:28.305279 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 21791
I20260810 04:12:28.305352 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:12:28.305518 11238 external_mini_cluster.cc:1428] Setting key de3d02eb81103643eb69f6595f8425c9
I20260810 04:12:28.306309 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 04:12:28.307938 21491 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:12:28.307551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58654 (local address 127.10.249.190:37325)
0810 04:12:28.307584 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:28.307586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:28.307713 (+ 127us) server_negotiation.cc:407] Connection header received
0810 04:12:28.307760 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:28.307761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:28.307764 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:28.307804 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:28.307903 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58654: BlockingRecv error: recv got EOF from 127.0.0.1:58654 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
I20260810 04:12:28.308070 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 21511
I20260810 04:12:28.317410 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 21650
I20260810 04:12:28.321918 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 21791
I20260810 04:12:28.326586 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 21414
2026-08-10T04:12:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (516 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:12:28 dist-test-slave-0kls krb5kdc[21938](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:12:28 dist-test-slave-0kls krb5kdc[21938](info): set up 2 sockets
Aug 10 04:12:28 dist-test-slave-0kls krb5kdc[21938](info): commencing operation
krb5kdc: starting...
W20260810 04:12:29.315760 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.970s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:12:29 dist-test-slave-0kls krb5kdc[21938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:12:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:12:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:12:29.422624 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42271
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:42271
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:29.498934 21951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:29.499159 21951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:29.499207 21951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:29.500368 21951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:12:29.500438 21951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:29.500463 21951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:29.500484 21951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:12:29.500514 21951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:12:29.501961 21951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:42271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:29.502238 21951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:29.502457 21951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:29.507212 21957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:29.507212 21956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:29.507249 21959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:29.507467 21951 server_base.cc:1034] running on GCE node
I20260810 04:12:29.507699 21951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:29.507953 21951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:29.509086 21951 hybrid_clock.cc:648] HybridClock initialized: now 1786335149509072 us; error 29 us; skew 500 ppm
Aug 10 04:12:29 dist-test-slave-0kls krb5kdc[21938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:29.511454 21951 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:12:29.511806 21951 webserver.cc:460] Webserver started at http://127.10.249.190:45071/ using document root <none> and password file <none>
I20260810 04:12:29.511984 21951 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:29.512023 21951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:29.512107 21951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:29.512992 21951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "a252e8ce6d57412bb2147e29010e5021"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "590c4467891d7462102bf0476d85eecd"
server_key_iv: "c0ea29e2f20e9b8c08a6acc2c6977d8d"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.513320 21951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "a252e8ce6d57412bb2147e29010e5021"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "590c4467891d7462102bf0476d85eecd"
server_key_iv: "c0ea29e2f20e9b8c08a6acc2c6977d8d"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.514607 21951 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:12:29.515236 21967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.515412 21951 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:29.515494 21951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "a252e8ce6d57412bb2147e29010e5021"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "590c4467891d7462102bf0476d85eecd"
server_key_iv: "c0ea29e2f20e9b8c08a6acc2c6977d8d"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.515594 21951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:29.531361 21951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:29.533414 21951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:29.533565 21951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:29.537427 21951 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:42271
I20260810 04:12:29.537506 22023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:42271 every 8 connection(s)
I20260810 04:12:29.537955 21951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:12:29.538861 22024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:29.541119 22024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021: Bootstrap starting.
I20260810 04:12:29.541713 22024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:29.542044 22024 log.cc:824] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:29.542810 22024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021: No bootstrap required, opened a new log
I20260810 04:12:29.544250 22024 raft_consensus.cc:348] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252e8ce6d57412bb2147e29010e5021" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42271 } }
I20260810 04:12:29.544375 22024 raft_consensus.cc:374] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:29.544423 22024 raft_consensus.cc:729] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a252e8ce6d57412bb2147e29010e5021, State: Initialized, Role: FOLLOWER
I20260810 04:12:29.544597 22024 consensus_queue.cc:260] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252e8ce6d57412bb2147e29010e5021" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42271 } }
I20260810 04:12:29.544700 22024 raft_consensus.cc:388] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:12:29.544725 22024 raft_consensus.cc:482] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:12:29.544795 22024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:29.545593 22024 raft_consensus.cc:504] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252e8ce6d57412bb2147e29010e5021" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42271 } }
I20260810 04:12:29.545694 22024 leader_election.cc:302] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a252e8ce6d57412bb2147e29010e5021; no voters:
I20260810 04:12:29.545859 22024 leader_election.cc:288] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:12:29.545866 22027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:29.546028 22027 raft_consensus.cc:686] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [term 1 LEADER]: Becoming Leader. State: Replica: a252e8ce6d57412bb2147e29010e5021, State: Running, Role: LEADER
I20260810 04:12:29.546131 22024 sys_catalog.cc:564] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:12:29.546183 22027 consensus_queue.cc:237] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252e8ce6d57412bb2147e29010e5021" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42271 } }
I20260810 04:12:29.546629 22029 sys_catalog.cc:455] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a252e8ce6d57412bb2147e29010e5021. Latest consensus state: current_term: 1 leader_uuid: "a252e8ce6d57412bb2147e29010e5021" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252e8ce6d57412bb2147e29010e5021" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42271 } } }
I20260810 04:12:29.546607 22028 sys_catalog.cc:455] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a252e8ce6d57412bb2147e29010e5021" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252e8ce6d57412bb2147e29010e5021" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42271 } } }
I20260810 04:12:29.546756 22029 sys_catalog.cc:458] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:29.546761 22028 sys_catalog.cc:458] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021 [sys.catalog]: This master's current role is: LEADER
I20260810 04:12:29.547274 22035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:12:29.547307 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 21951
I20260810 04:12:29.547413 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:12:29.547617 11238 external_mini_cluster.cc:1428] Setting key 73266e4da3375e483a01da6d47afc4e7
I20260810 04:12:29.547827 22035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:12:29.549933 22035 catalog_manager.cc:1347] Generated new cluster ID: 2d00c6a9933c4613908c7d07fc935766
I20260810 04:12:29.549998 22035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:12:29 dist-test-slave-0kls krb5kdc[21938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:12:29.556114 22035 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:12:29.557193 22035 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:12:29.559572 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:29.548075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33546 (local address 127.10.249.190:42271)
0810 04:12:29.548344 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:29.548353 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:29.548381 (+ 28us) server_negotiation.cc:407] Connection header received
0810 04:12:29.548474 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:29.548479 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:29.548540 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:29.548693 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:29.549515 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.550837 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.551909 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.552498 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.552605 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:29.555253 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:29.555257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:29.555257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:29.555275 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:29.557984 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:29.558407 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:29.558410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:29.558410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:29.558505 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:29.558729 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:29.558730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:29.558730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:29.558983 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:29.559111 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:29.559255 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 04:12:29.559392 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":109,"threads_started":1}
I20260810 04:12:29.562637 22035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021: Generated new TSK 0
I20260810 04:12:29.562796 22035 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:12:29.588760 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42271
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:29.664665 22050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:29.664866 22050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:29.664889 22050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:29.666024 22050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:29.666061 22050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:29.666086 22050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:12:29.667500 22050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:29.667742 22050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:29.668000 22050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:29.672748 22056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:29.672736 22055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:29.672725 22058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:29.672763 22050 server_base.cc:1034] running on GCE node
I20260810 04:12:29.673007 22050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:29.673241 22050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:29.674393 22050 hybrid_clock.cc:648] HybridClock initialized: now 1786335149674380 us; error 41 us; skew 500 ppm
Aug 10 04:12:29 dist-test-slave-0kls krb5kdc[21938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:29.676752 22050 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:12:29.677181 22050 webserver.cc:460] Webserver started at http://127.10.249.129:35251/ using document root <none> and password file <none>
I20260810 04:12:29.677358 22050 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:29.677397 22050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:29.677479 22050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:29.678426 22050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "71ee7c103bac459caaeb0417d37d41d3"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "0278d4bf5014583676730d10b02ce035"
server_key_iv: "1e92258ce178f767b40757f4a32ee18b"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.678680 22050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "71ee7c103bac459caaeb0417d37d41d3"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "0278d4bf5014583676730d10b02ce035"
server_key_iv: "1e92258ce178f767b40757f4a32ee18b"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.679829 22050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:12:29.680491 22067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.680684 22050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:29.680759 22050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "71ee7c103bac459caaeb0417d37d41d3"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "0278d4bf5014583676730d10b02ce035"
server_key_iv: "1e92258ce178f767b40757f4a32ee18b"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.680850 22050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:29.690521 22050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:29.692444 22050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:29.692581 22050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:29.692788 22050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:29.693089 22050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:29.693128 22050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.693156 22050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:29.693168 22050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.698804 22050 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:35755
I20260810 04:12:29.698850 22186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:35755 every 8 connection(s)
I20260810 04:12:29.699095 22050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:12:29.703114 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 22050
I20260810 04:12:29.703193 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:12:29.703394 11238 external_mini_cluster.cc:1428] Setting key 2852fe957a3e721c5c59273a9a06ca1f
Aug 10 04:12:29 dist-test-slave-0kls krb5kdc[21938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:12:29.708052 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:29.699727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:51095 (local address 127.10.249.190:42271)
0810 04:12:29.699779 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:29.699781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:29.699998 (+ 217us) server_negotiation.cc:407] Connection header received
0810 04:12:29.700403 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:29.700404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:29.700414 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:29.700465 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:29.701265 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.701721 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.702553 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.702734 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.702783 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:29.705292 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:29.705293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:29.705294 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:29.705301 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:29.706650 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:29.707158 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:29.707159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:29.707159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:29.707208 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:29.707477 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:29.707478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:29.707478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:29.707573 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:29.707621 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:29.707927 (+ 306us) server_negotiation.cc:299] Negotiation successful
0810 04:12:29.707991 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 04:12:29.708361 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:29.699714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:42271 (local address 127.10.249.129:51095)
0810 04:12:29.699885 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:29.699915 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:29.700325 (+ 410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:29.700511 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:29.700514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:29.701019 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:29.701194 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:29.701198 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.701806 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.701806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:29.702485 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:29.702487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.702813 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.702813 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:29.702900 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:29.703409 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:29.703417 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:29.705199 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:29.706760 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:29.706767 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:29.706769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:29.707071 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:29.707271 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:29.707272 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:29.707273 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:29.707415 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:29.707635 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:29.707642 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:29.707796 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 04:12:29.707908 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 04:12:29.708083 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":114,"threads_started":1}
I20260810 04:12:29.708885 22187 heartbeater.cc:347] Connected to a master server at 127.10.249.190:42271
I20260810 04:12:29.708988 22187 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:29.709149 22187 heartbeater.cc:511] Master 127.10.249.190:42271 requested a full tablet report, sending...
I20260810 04:12:29.709671 21984 ts_manager.cc:194] Registered new tserver with Master: 71ee7c103bac459caaeb0417d37d41d3 (127.10.249.129:35755)
I20260810 04:12:29.710640 21984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:51095
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:12:29.728129 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42271
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:29.807551 22192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:29.807785 22192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:29.807824 22192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:29.808979 22192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:29.809047 22192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:29.809092 22192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:12:29.810547 22192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:29.810815 22192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:29.811043 22192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:12:29.815896 22192 server_base.cc:1034] running on GCE node
W20260810 04:12:29.815857 22200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:29.815847 22197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:29.815857 22198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:29.816358 22192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:29.816547 22192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:29.817687 22192 hybrid_clock.cc:648] HybridClock initialized: now 1786335149817680 us; error 33 us; skew 500 ppm
Aug 10 04:12:29 dist-test-slave-0kls krb5kdc[21938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:29.820300 22192 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:12:29.820667 22192 webserver.cc:460] Webserver started at http://127.10.249.130:44353/ using document root <none> and password file <none>
I20260810 04:12:29.820848 22192 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:29.820887 22192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:29.820982 22192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:29.821978 22192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "4246d7e740754eae913a5bd80b95b40d"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "9c4590639bd4e33d44ca307e37368b75"
server_key_iv: "3cee0421acf34e109889a85594c2cc3a"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.822296 22192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "4246d7e740754eae913a5bd80b95b40d"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "9c4590639bd4e33d44ca307e37368b75"
server_key_iv: "3cee0421acf34e109889a85594c2cc3a"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.823489 22192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:12:29.824119 22208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.824290 22192 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.824393 22192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "4246d7e740754eae913a5bd80b95b40d"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "9c4590639bd4e33d44ca307e37368b75"
server_key_iv: "3cee0421acf34e109889a85594c2cc3a"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.824462 22192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:29.841240 22192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:29.843436 22192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:29.843586 22192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:29.843801 22192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:29.844098 22192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:29.844174 22192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.844218 22192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:29.844244 22192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.850438 22192 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:39053
I20260810 04:12:29.850490 22329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:39053 every 8 connection(s)
I20260810 04:12:29.850775 22192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:12:29.852478 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 22192
I20260810 04:12:29.852589 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:12:29.852764 11238 external_mini_cluster.cc:1428] Setting key b66fba49b1fec9176ee01a541d1ca15f
Aug 10 04:12:29 dist-test-slave-0kls krb5kdc[21938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:12:29.860973 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:29.851453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:45921 (local address 127.10.249.190:42271)
0810 04:12:29.851534 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:29.851536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:29.851759 (+ 223us) server_negotiation.cc:407] Connection header received
0810 04:12:29.852209 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:29.852211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:29.852220 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:29.852268 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:29.853442 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.854030 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.855454 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.855795 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.855875 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:29.858198 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:29.858200 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:29.858200 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:29.858209 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:29.859547 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:29.859988 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:29.859990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:29.859991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:29.860052 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:29.860307 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:29.860308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:29.860309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:29.860427 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:29.860506 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:29.860794 (+ 288us) server_negotiation.cc:299] Negotiation successful
0810 04:12:29.860881 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:12:29.861166 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:29.851437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:42271 (local address 127.10.249.130:45921)
0810 04:12:29.851632 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:29.851666 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:29.852121 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:29.852349 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:29.852352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:29.853070 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:29.853306 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:29.853313 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.854129 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.854131 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:29.855359 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:29.855362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:29.855882 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:29.855883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:29.855986 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:29.856512 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:29.856523 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:29.858096 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:29.859633 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:29.859641 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:29.859643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:29.859907 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:29.860121 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:29.860122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:29.860122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:29.860237 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:29.860497 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:29.860504 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:29.860647 (+ 143us) client_negotiation.cc:769] Sending connection context
0810 04:12:29.860759 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 04:12:29.860917 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":117,"threads_started":1}
I20260810 04:12:29.861697 22330 heartbeater.cc:347] Connected to a master server at 127.10.249.190:42271
I20260810 04:12:29.861833 22330 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:29.862041 22330 heartbeater.cc:511] Master 127.10.249.190:42271 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
I20260810 04:12:29.862450 21984 ts_manager.cc:194] Registered new tserver with Master: 4246d7e740754eae913a5bd80b95b40d (127.10.249.130:39053)
I20260810 04:12:29.862867 21984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:45921
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:12:29.878754 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42271
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:12:29.956393 22335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:12:29.956568 22335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:12:29.956586 22335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:12:29.957649 22335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:12:29.957682 22335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:12:29.957707 22335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:12:29.959012 22335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:42271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:12:29.959190 22335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:12:29.959360 22335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:12:29.964237 22341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:29.964238 22340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:12:29.964355 22343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:12:29.964392 22335 server_base.cc:1034] running on GCE node
I20260810 04:12:29.964711 22335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:12:29.964995 22335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:12:29.966154 22335 hybrid_clock.cc:648] HybridClock initialized: now 1786335149966152 us; error 53 us; skew 500 ppm
Aug 10 04:12:29 dist-test-slave-0kls krb5kdc[21938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:12:29.968538 22335 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:12:29.968966 22335 webserver.cc:460] Webserver started at http://127.10.249.131:34653/ using document root <none> and password file <none>
I20260810 04:12:29.969187 22335 fs_manager.cc:359] Metadata directory not provided
I20260810 04:12:29.969249 22335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:12:29.969390 22335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:12:29.970412 22335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "057c252e8d5143d982d6e5359d5e8eb6"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "58f84d0aa5382647f84f5bad7cae6708"
server_key_iv: "46de121f58ca5f05e550a35b0b52cc4b"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.970741 22335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "057c252e8d5143d982d6e5359d5e8eb6"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "58f84d0aa5382647f84f5bad7cae6708"
server_key_iv: "46de121f58ca5f05e550a35b0b52cc4b"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.971985 22335 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:12:29.972693 22351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:29.972859 22335 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:12:29.972981 22335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "057c252e8d5143d982d6e5359d5e8eb6"
format_stamp: "Formatted at 2026-08-10 04:12:29 on dist-test-slave-0kls"
server_key: "58f84d0aa5382647f84f5bad7cae6708"
server_key_iv: "46de121f58ca5f05e550a35b0b52cc4b"
server_key_version: "encryptionkey@0"
I20260810 04:12:29.973032 22335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:12:30.008543 22335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:12:30.012444 22335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:12:30.012584 22335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:12:30.012792 22335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:12:30.013108 22335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:12:30.013139 22335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:30.013202 22335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:12:30.013227 22335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:12:30.019354 22335 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:45073
I20260810 04:12:30.019418 22469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:45073 every 8 connection(s)
I20260810 04:12:30.019766 22335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:12:30.023623 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 22335
I20260810 04:12:30.023751 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:12:30.023998 11238 external_mini_cluster.cc:1428] Setting key 72d267208f120c6dd265718756844d22
Aug 10 04:12:30 dist-test-slave-0kls krb5kdc[21938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335149, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:12:30.029335 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.020460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:53429 (local address 127.10.249.190:42271)
0810 04:12:30.020526 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:30.020528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:30.020756 (+ 228us) server_negotiation.cc:407] Connection header received
0810 04:12:30.021290 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:30.021291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:30.021301 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:30.021358 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:30.022393 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.022891 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.023916 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.024199 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.024284 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.026516 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:30.026520 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:30.026520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:30.026532 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:30.027810 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:30.028306 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:30.028308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:30.028308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:30.028371 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:30.028645 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:30.028646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:30.028647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:30.028791 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:30.028866 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:30.029149 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 04:12:30.029245 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:12:30.029517 22472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.020458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:42271 (local address 127.10.249.131:53429)
0810 04:12:30.020613 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:30.020662 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:30.021181 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:30.021437 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:30.021441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:30.022095 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:12:30.022311 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.022317 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.022970 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.022970 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.023826 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.023830 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.024295 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.024297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.024439 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.024932 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:12:30.024944 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:12:30.026358 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:12:30.027911 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:30.027918 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:30.027920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:30.028229 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:30.028454 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:12:30.028454 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:12:30.028455 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:12:30.028579 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:12:30.028868 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:12:30.028876 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:12:30.029018 (+ 142us) client_negotiation.cc:769] Sending connection context
0810 04:12:30.029124 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 04:12:30.029280 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":86,"threads_started":1}
I20260810 04:12:30.030027 22470 heartbeater.cc:347] Connected to a master server at 127.10.249.190:42271
I20260810 04:12:30.030135 22470 heartbeater.cc:464] Registering TS with master...
I20260810 04:12:30.030316 22470 heartbeater.cc:511] Master 127.10.249.190:42271 requested a full tablet report, sending...
I20260810 04:12:30.030725 21984 ts_manager.cc:194] Registered new tserver with Master: 057c252e8d5143d982d6e5359d5e8eb6 (127.10.249.131:45073)
I20260810 04:12:30.031121 21984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:53429
I20260810 04:12:30.035593 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:12:30.042529 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.036900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33552 (local address 127.10.249.190:42271)
0810 04:12:30.036977 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:30.036979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:30.037098 (+ 119us) server_negotiation.cc:407] Connection header received
0810 04:12:30.037174 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:30.037175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:30.037186 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:30.037257 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:12:30.037824 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.038276 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.039012 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.039187 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.039264 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.040299 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:12:30.040300 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:12:30.040301 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:12:30.040308 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:12:30.041354 (+ 1046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:30.041697 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:30.041698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:30.041699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:30.041756 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:12:30.041999 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:12:30.042000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:12:30.042000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:12:30.042145 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:12:30.042254 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:30.042372 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 04:12:30.042443 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:12:30.043779 21984 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:12:30.045117 21984 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:12:30.051456 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.047094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:45073 (local address 127.0.0.1:47148)
0810 04:12:30.047455 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:30.047465 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:30.047504 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:30.048223 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:30.048224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:30.048225 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:30.048244 (+ 19us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.048245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.049020 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.049021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.050238 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.050241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.051152 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.051154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.051265 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.051280 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 04:12:30.051343 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 04:12:30.051390 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":21,"thread_start_us":54,"threads_started":1}
I20260810 04:12:30.051489 22482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.047301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.10.249.131:45073)
0810 04:12:30.047884 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:30.047887 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:30.047896 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:30.047929 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:30.047931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:30.047945 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:30.048014 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:30.048309 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.048929 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.050318 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.051046 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.051129 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.051200 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:30.051370 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 04:12:30.051410 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":78,"threads_started":1}
I20260810 04:12:30.051707 22484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.047328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51188 (local address 127.10.249.129:35755)
0810 04:12:30.047521 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:30.047527 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:30.047632 (+ 105us) server_negotiation.cc:407] Connection header received
0810 04:12:30.047681 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:30.047683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:30.047765 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:30.047836 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:30.048147 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.049192 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.050443 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.051127 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.051216 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.051275 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:30.051610 (+ 335us) server_negotiation.cc:299] Negotiation successful
0810 04:12:30.051652 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":76,"threads_started":1}
I20260810 04:12:30.051553 22480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.047096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:35755 (local address 127.0.0.1:51188)
0810 04:12:30.047501 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:30.047512 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:30.047574 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:30.047943 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:30.047946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:30.047948 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:30.048064 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.048068 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.049291 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.049292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.050356 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.050358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.051306 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.051306 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.051386 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.051390 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:30.051437 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 04:12:30.051475 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":64,"threads_started":1}
I20260810 04:12:30.052296 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.047092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:39053 (local address 127.0.0.1:49770)
0810 04:12:30.047251 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:30.047317 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:30.047385 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:30.048078 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:30.048079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:30.048081 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:30.048142 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.048153 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.050432 (+ 2279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.050433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.051121 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.051123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.052058 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.052059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.052137 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.052139 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:12:30.052205 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:12:30.052240 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":66,"threads_started":1}
I20260810 04:12:30.052331 22483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.047299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49770 (local address 127.10.249.130:39053)
0810 04:12:30.047598 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:30.047601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:30.047611 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:12:30.047652 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:30.047654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:30.047670 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:30.047745 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:30.048211 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.049196 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.051226 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.051926 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.051982 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.052027 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:30.052223 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 04:12:30.052259 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":99,"threads_started":1}
I20260810 04:12:30.052374 22117 tablet_service.cc:1467] Processing CreateTablet for tablet 087dee241cef4c05824830db85a8b778 (DEFAULT_TABLE table=test-table [id=bdd2dafb4b0d48919ed9a4e4c3fd8180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:30.052368 22402 tablet_service.cc:1467] Processing CreateTablet for tablet 087dee241cef4c05824830db85a8b778 (DEFAULT_TABLE table=test-table [id=bdd2dafb4b0d48919ed9a4e4c3fd8180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:30.052709 22402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087dee241cef4c05824830db85a8b778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:30.052706 22117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087dee241cef4c05824830db85a8b778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:30.053036 22260 tablet_service.cc:1467] Processing CreateTablet for tablet 087dee241cef4c05824830db85a8b778 (DEFAULT_TABLE table=test-table [id=bdd2dafb4b0d48919ed9a4e4c3fd8180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:12:30.053324 22260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087dee241cef4c05824830db85a8b778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:12:30.055815 22485 tablet_bootstrap.cc:492] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Bootstrap starting.
I20260810 04:12:30.056344 22485 tablet_bootstrap.cc:654] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:30.056954 22485 log.cc:824] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:30.057286 22486 tablet_bootstrap.cc:492] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: Bootstrap starting.
I20260810 04:12:30.057647 22485 tablet_bootstrap.cc:492] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: No bootstrap required, opened a new log
I20260810 04:12:30.057704 22485 ts_tablet_manager.cc:1397] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:12:30.057931 22486 tablet_bootstrap.cc:654] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:30.058403 22486 log.cc:824] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:30.058706 22487 tablet_bootstrap.cc:492] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3: Bootstrap starting.
I20260810 04:12:30.059181 22487 tablet_bootstrap.cc:654] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3: Neither blocks nor log segments found. Creating new log.
I20260810 04:12:30.059203 22485 raft_consensus.cc:348] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.059383 22485 raft_consensus.cc:374] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:30.059427 22485 raft_consensus.cc:729] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4246d7e740754eae913a5bd80b95b40d, State: Initialized, Role: FOLLOWER
I20260810 04:12:30.059562 22485 consensus_queue.cc:260] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.059727 22487 log.cc:824] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:12:30.059881 22485 ts_tablet_manager.cc:1428] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:12:30.059896 22330 heartbeater.cc:503] Master 127.10.249.190:42271 was elected leader, sending a full tablet report...
I20260810 04:12:30.060294 22486 tablet_bootstrap.cc:492] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: No bootstrap required, opened a new log
I20260810 04:12:30.060365 22486 ts_tablet_manager.cc:1397] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260810 04:12:30.061882 22486 raft_consensus.cc:348] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.061991 22486 raft_consensus.cc:374] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:30.062011 22486 raft_consensus.cc:729] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 057c252e8d5143d982d6e5359d5e8eb6, State: Initialized, Role: FOLLOWER
I20260810 04:12:30.062116 22487 tablet_bootstrap.cc:492] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3: No bootstrap required, opened a new log
I20260810 04:12:30.062117 22486 consensus_queue.cc:260] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.062184 22487 ts_tablet_manager.cc:1397] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 04:12:30.062430 22486 ts_tablet_manager.cc:1428] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:12:30.062451 22470 heartbeater.cc:503] Master 127.10.249.190:42271 was elected leader, sending a full tablet report...
I20260810 04:12:30.064049 22487 raft_consensus.cc:348] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.064191 22487 raft_consensus.cc:374] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:12:30.064254 22487 raft_consensus.cc:729] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ee7c103bac459caaeb0417d37d41d3, State: Initialized, Role: FOLLOWER
I20260810 04:12:30.064370 22487 consensus_queue.cc:260] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.064635 22487 ts_tablet_manager.cc:1428] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:12:30.064766 22187 heartbeater.cc:503] Master 127.10.249.190:42271 was elected leader, sending a full tablet report...
W20260810 04:12:30.101258 22331 tablet.cc:2369] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:12:30.171164 22490 raft_consensus.cc:482] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:12:30.171273 22490 raft_consensus.cc:504] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.171593 22490 leader_election.cc:288] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ee7c103bac459caaeb0417d37d41d3 (127.10.249.129:35755), 057c252e8d5143d982d6e5359d5e8eb6 (127.10.249.131:45073)
I20260810 04:12:30.174925 22482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.171858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:49403 (local address 127.10.249.131:45073)
0810 04:12:30.171895 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:30.171897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:30.172205 (+ 308us) server_negotiation.cc:407] Connection header received
0810 04:12:30.172237 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:30.172238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:30.172250 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:30.172317 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:30.172548 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.172985 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.174020 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.174580 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.174653 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.174662 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:30.174822 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 04:12:30.174862 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:12:30.174942 22484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.171851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:57363 (local address 127.10.249.129:35755)
0810 04:12:30.171894 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:30.171897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:30.171906 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:12:30.171962 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:30.171963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:30.171973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:30.172038 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:12:30.172389 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.172895 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.174084 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.174579 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.174653 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.174662 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:30.174822 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 04:12:30.174861 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:12:30.174950 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.171777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:35755 (local address 127.10.249.130:57363)
0810 04:12:30.171843 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:30.171855 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:30.171898 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:30.172194 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:30.172195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:30.172197 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:30.172276 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.172278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.172970 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.172971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.173952 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.173970 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.174663 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.174664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.174743 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.174744 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:12:30.174806 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:12:30.174853 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":46}
I20260810 04:12:30.174958 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.171777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:45073 (local address 127.10.249.130:49403)
0810 04:12:30.171980 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:30.171990 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:12:30.172046 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:12:30.172377 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:12:30.172378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:12:30.172380 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:12:30.172465 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.172467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.173066 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.173067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.173946 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:12:30.173949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.174663 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.174664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:12:30.174740 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.174744 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:12:30.174806 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:12:30.174853 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":28,"thread_start_us":99,"threads_started":1}
I20260810 04:12:30.175295 22137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087dee241cef4c05824830db85a8b778" candidate_uuid: "4246d7e740754eae913a5bd80b95b40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ee7c103bac459caaeb0417d37d41d3" is_pre_election: true
I20260810 04:12:30.175392 22423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087dee241cef4c05824830db85a8b778" candidate_uuid: "4246d7e740754eae913a5bd80b95b40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057c252e8d5143d982d6e5359d5e8eb6" is_pre_election: true
I20260810 04:12:30.175482 22137 raft_consensus.cc:2454] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4246d7e740754eae913a5bd80b95b40d in term 0.
I20260810 04:12:30.175587 22423 raft_consensus.cc:2454] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4246d7e740754eae913a5bd80b95b40d in term 0.
I20260810 04:12:30.175731 22209 leader_election.cc:302] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4246d7e740754eae913a5bd80b95b40d, 71ee7c103bac459caaeb0417d37d41d3; no voters:
I20260810 04:12:30.175858 22490 raft_consensus.cc:2781] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:12:30.175902 22490 raft_consensus.cc:482] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:12:30.175925 22490 raft_consensus.cc:3037] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:30.176627 22490 raft_consensus.cc:504] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.176806 22490 leader_election.cc:288] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [CANDIDATE]: Term 1 election: Requested vote from peers 71ee7c103bac459caaeb0417d37d41d3 (127.10.249.129:35755), 057c252e8d5143d982d6e5359d5e8eb6 (127.10.249.131:45073)
I20260810 04:12:30.176968 22423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087dee241cef4c05824830db85a8b778" candidate_uuid: "4246d7e740754eae913a5bd80b95b40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "057c252e8d5143d982d6e5359d5e8eb6"
I20260810 04:12:30.176996 22137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087dee241cef4c05824830db85a8b778" candidate_uuid: "4246d7e740754eae913a5bd80b95b40d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ee7c103bac459caaeb0417d37d41d3"
I20260810 04:12:30.177059 22137 raft_consensus.cc:3037] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:30.177059 22423 raft_consensus.cc:3037] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:12:30.178001 22137 raft_consensus.cc:2454] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4246d7e740754eae913a5bd80b95b40d in term 1.
I20260810 04:12:30.178001 22423 raft_consensus.cc:2454] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4246d7e740754eae913a5bd80b95b40d in term 1.
I20260810 04:12:30.178187 22209 leader_election.cc:302] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4246d7e740754eae913a5bd80b95b40d, 71ee7c103bac459caaeb0417d37d41d3; no voters:
I20260810 04:12:30.178270 22490 raft_consensus.cc:2781] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:12:30.178408 22490 raft_consensus.cc:686] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 1 LEADER]: Becoming Leader. State: Replica: 4246d7e740754eae913a5bd80b95b40d, State: Running, Role: LEADER
I20260810 04:12:30.178509 22490 consensus_queue.cc:237] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } }
I20260810 04:12:30.179255 21984 catalog_manager.cc:5495] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4246d7e740754eae913a5bd80b95b40d (127.10.249.130). New cstate: current_term: 1 leader_uuid: "4246d7e740754eae913a5bd80b95b40d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4246d7e740754eae913a5bd80b95b40d" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 39053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 } health_report { overall_health: UNKNOWN } } }
I20260810 04:12:30.195242 22483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.193417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49772 (local address 127.10.249.130:39053)
0810 04:12:30.193460 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:12:30.193462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:12:30.193485 (+ 23us) server_negotiation.cc:407] Connection header received
0810 04:12:30.193549 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:12:30.193549 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:12:30.193562 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:12:30.193604 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:12:30.193695 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.194105 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.194708 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:12:30.194862 (+ 154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:12:30.194905 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:12:30.195016 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:12:30.195096 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:12:30.195155 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:12:30.195169 (+ 14us) server_negotiation.cc:299] Negotiation successful
0810 04:12:30.195184 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:12:30.196810 22137 raft_consensus.cc:1261] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 1 FOLLOWER]: Refusing update from remote peer 4246d7e740754eae913a5bd80b95b40d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:30.196810 22423 raft_consensus.cc:1261] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 1 FOLLOWER]: Refusing update from remote peer 4246d7e740754eae913a5bd80b95b40d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:12:30.197166 22496 consensus_queue.cc:1035] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [LEADER]: Connected to new peer: Peer: permanent_uuid: "057c252e8d5143d982d6e5359d5e8eb6" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 45073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:30.197286 22490 consensus_queue.cc:1035] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ee7c103bac459caaeb0417d37d41d3" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:12:30.200099 22501 mvcc.cc:205] Tried to move back new op lower bound from 7316828775203516416 to 7316828775131787264. Current Snapshot: MvccSnapshot[applied={T|T < 7316828775203516416}]
I20260810 04:12:30.202693 21984 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:30.202800 21984 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:12:30.203527 21984 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a252e8ce6d57412bb2147e29010e5021: Sending DeleteTablet for 3 replicas of tablet 087dee241cef4c05824830db85a8b778
I20260810 04:12:30.203833 22260 tablet_service.cc:1514] Processing DeleteTablet for tablet 087dee241cef4c05824830db85a8b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:30 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:49770
I20260810 04:12:30.203907 22402 tablet_service.cc:1514] Processing DeleteTablet for tablet 087dee241cef4c05824830db85a8b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:30 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:47148
I20260810 04:12:30.203955 22117 tablet_service.cc:1514] Processing DeleteTablet for tablet 087dee241cef4c05824830db85a8b778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:12:30 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:51188
I20260810 04:12:30.204187 22509 tablet_replica.cc:330] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: stopping tablet replica
I20260810 04:12:30.204210 22511 tablet_replica.cc:330] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3: stopping tablet replica
I20260810 04:12:30.204296 22509 raft_consensus.cc:2229] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:12:30.204416 22509 raft_consensus.cc:2258] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:30.204425 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 22050
I20260810 04:12:30.204428 22511 raft_consensus.cc:2229] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:30.204643 22511 raft_consensus.cc:2258] T 087dee241cef4c05824830db85a8b778 P 71ee7c103bac459caaeb0417d37d41d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:30.204833 22509 ts_tablet_manager.cc:1905] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:12:30.206874 22509 ts_tablet_manager.cc:1918] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:12:30.206969 22509 log.cc:1196] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/087dee241cef4c05824830db85a8b778
I20260810 04:12:30.207273 22509 ts_tablet_manager.cc:1939] T 087dee241cef4c05824830db85a8b778 P 4246d7e740754eae913a5bd80b95b40d: Deleting consensus metadata
I20260810 04:12:30.207695 21971 catalog_manager.cc:4841] TS 4246d7e740754eae913a5bd80b95b40d (127.10.249.130:39053): tablet 087dee241cef4c05824830db85a8b778 (table test-table [id=bdd2dafb4b0d48919ed9a4e4c3fd8180]) successfully deleted
W20260810 04:12:30.211813 21968 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:35755 (error 108)
I20260810 04:12:30.212000 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 22192
I20260810 04:12:30.212109 22510 tablet_replica.cc:330] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: stopping tablet replica
I20260810 04:12:30.212203 22510 raft_consensus.cc:2229] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:12:30.212281 22510 raft_consensus.cc:2258] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:12:30.213045 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:12:30.212873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:35755 (local address 127.0.0.1:51192)
0810 04:12:30.212947 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0810 04:12:30.212991 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:35755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 04:12:30.213913 22510 ts_tablet_manager.cc:1905] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 04:12:30.213927 21968 catalog_manager.cc:4584] TS 71ee7c103bac459caaeb0417d37d41d3 (127.10.249.129:35755): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 087dee241cef4c05824830db85a8b778: Network error: Client connection negotiation failed: client connection to 127.10.249.129:35755: connect: Connection refused (error 111)
I20260810 04:12:30.215637 22510 ts_tablet_manager.cc:1918] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:12:30.215714 22510 log.cc:1196] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/087dee241cef4c05824830db85a8b778
I20260810 04:12:30.215970 22510 ts_tablet_manager.cc:1939] T 087dee241cef4c05824830db85a8b778 P 057c252e8d5143d982d6e5359d5e8eb6: Deleting consensus metadata
I20260810 04:12:30.216370 21970 catalog_manager.cc:4841] TS 057c252e8d5143d982d6e5359d5e8eb6 (127.10.249.131:45073): tablet 087dee241cef4c05824830db85a8b778 (table test-table [id=bdd2dafb4b0d48919ed9a4e4c3fd8180]) successfully deleted
I20260810 04:12:30.217700 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 22335
I20260810 04:12:30.222268 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 21951
2026-08-10T04:12:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1896 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:12:30 dist-test-slave-0kls krb5kdc[22516](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:12:30 dist-test-slave-0kls krb5kdc[22516](info): set up 2 sockets
Aug 10 04:12:30 dist-test-slave-0kls krb5kdc[22516](info): commencing operation
krb5kdc: starting...
W20260810 04:12:31.220808 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.978s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:12:31 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:12:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:12:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.249.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.249.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/rangeradmin_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/rangeradmin_127.10.249.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.249.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.249.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/rangerlookup_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/rangerlookup_127.10.249.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.249.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.249.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/HTTP_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/HTTP_127.10.249.148@KRBTEST.COM.keytab.
I20260810 04:12:31.372421 11238 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZcp64r/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/postgres -l logfile start
2026-08-10 04:12:33.685 UTC [22548] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 04:12:33.685 UTC [22548] LOG: listening on IPv4 address "127.10.249.148", port 59957
2026-08-10 04:12:33.688 UTC [22548] LOG: listening on Unix socket "/tmp/.s.PGSQL.59957"
2026-08-10 04:12:33.721 UTC [22551] LOG: database system was shut down at 2026-08-10 04:12:32 UTC
2026-08-10 04:12:33.725 UTC [22548] LOG: database system is ready to accept connections
I20260810 04:12:34.619143 11238 mini_postgres.cc:96] Postgres bound to 59957
2026-08-10 04:12:34.626 UTC [22559] FATAL: database "slave" does not exist
127.10.249.148:59957 - accepting connections
I20260810 04:12:34.626996 11238 mini_ranger.cc:161] Starting Ranger...
I20260810 04:12:34.643160 11238 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 04:12:35.063925 11238 mini_ranger.cc:87] Created ranger Postgres database
I20260810 04:12:35.064010 11238 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-admin
2026-08-10 04:12:35,332 [I] DB FLAVOR :POSTGRES
2026-08-10 04:12:35,333 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 04:12:35,333 [I] Checking connection..
2026-08-10 04:12:35,333 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 04:12:35,562 [I] Checking connection passed.
2026-08-10 04:12:35,562 [I] --------- Verifying version history table ---------
2026-08-10 04:12:35,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:12:35,813 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 04:12:35,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:12:36,064 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 04:12:36,064 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 04:12:36,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 04:12:36.300 UTC [22627] WARNING: there is no transaction in progress
2026-08-10 04:12:36,307 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 04:12:36,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:12:36,561 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 04:12:36,562 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 04:12:36,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 04:12:36,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 04:12:37,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0kls.c.gcp-upstream.internal','N') ;"
2026-08-10 04:12:37,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 04:12:37,517 [I] Table x_portal_user does not exist in database ranger
2026-08-10 04:12:37,517 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 04:12:37,753 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 04:12:37,754 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 04:12:37,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 04:12:38,227 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 04:12:38,227 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 04:12:39.108 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.122 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.138 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.151 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.168 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.183 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.231 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.237 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.250 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.260 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.270 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.282 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.291 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.297 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.303 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39.310 UTC [22745] WARNING: there is no transaction in progress
2026-08-10 04:12:39,901 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 04:12:39,901 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 04:12:40,126 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 04:12:40,126 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 04:12:40,372 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 04:12:40,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 04:12:40,616 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 04:12:40,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 04:12:40,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 04:12:41,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0kls.c.gcp-upstream.internal';"
2026-08-10 04:12:41,314 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 04:12:41,314 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 04:12:41,544 [I] DB_PATCHES have already been applied
I20260810 04:12:41.549877 11238 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZcp64r/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 04:12:41.549935 11238 mini_ranger.cc:193] Using host: 127.10.249.148
I20260810 04:12:41.553265 11238 mini_ranger.cc:227] Ranger admin URL: http://127.10.249.148:44127
Aug 10, 2026 4:12:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 4:12:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 4:12:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 4:12:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 4:12:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 4:12:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 4:12:42 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 04:12:42.651816 11238 mini_ranger.cc:160] Time spent starting Ranger: real 8.025s user 0.000s sys 0.010s
Aug 10, 2026 4:13:02 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 4:13:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 4:13:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 4:13:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 4:13:02 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 04:13:03.448648 11238 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.249.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.249.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/rangerkms_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/rangerkms_127.10.249.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.249.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.249.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.249.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/HTTP_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.249.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/HTTP_127.10.249.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 04:13:03 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335183, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 04:13:03.528421 11238 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 04:13:03.537478 11238 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 04:13:04.312215 11238 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 04:13:04.312306 11238 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms
I20260810 04:13:04.312328 11238 mini_ranger_kms.cc:227] Using postgres at 127.10.249.148:59957
2026-08-10 04:13:05,228 [I] DB FLAVOR :POSTGRES
2026-08-10 04:13:05,228 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 04:13:05,228 [I] Checking connection
2026-08-10 04:13:05,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 04:13:05,551 [I] connection success
2026-08-10 04:13:05,551 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 04:13:05,551 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 04:13:05,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 04:13:05,800 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 04:13:05,801 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 04:13:05,801 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 04:13:05,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:59957/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 04:13:06,034 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 04:13:06.483559 11238 mini_ranger_kms.cc:310] Created kms service
I20260810 04:13:06.714712 11238 mini_ranger_kms.cc:326] Created kudu user
I20260810 04:13:06.757949 11238 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 04:13:06 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335183, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:07.131301 11238 mini_ranger_kms.cc:384] Added ranger policy
I20260810 04:13:07.131426 11238 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 04:13:07.131448 11238 mini_ranger_kms.cc:240] Using host: 127.10.249.148
I20260810 04:13:07.135636 11238 mini_ranger_kms.cc:276] Ranger KMS PID: 22934
I20260810 04:13:07.135735 11238 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.249.148:48563
Aug 10, 2026 4:13:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 4:13:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 4:13:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 4:13:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 4:13:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 4:13:09 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260810 04:13:09.362450 11238 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.834s user 0.005s sys 0.547s
I20260810 04:13:09.362550 11238 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 04:13:09.362622 11238 mini_ranger_kms.cc:401] 127.10.249.148:48563/kms/v1/keys
Aug 10 04:13:09 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786335189, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.249.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 04:13:10 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335189, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.249.148@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
Aug 10 04:13:10 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335189, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.249.148@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
Aug 10 04:13:13 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:13:13.074397 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43005
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:43005
--ranger_config_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:48563/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:13.183573 22990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:13.183794 22990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:13.183830 22990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:13.184934 22990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:13:13.184995 22990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:13.185036 22990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:13.185063 22990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:13:13.185082 22990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:13:13.186779 22990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.249.148:48563/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:43005
--ranger_config_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:13.187048 22990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:13.187286 22990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:13.193382 22999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:13.193454 22996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:13.193493 22990 server_base.cc:1034] running on GCE node
W20260810 04:13:13.193601 22997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:13.193939 22990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:13.194247 22990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:13.195391 22990 hybrid_clock.cc:648] HybridClock initialized: now 1786335193195368 us; error 40 us; skew 500 ppm
Aug 10 04:13:13 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335193, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:13.198299 22990 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:13:13.198740 22990 webserver.cc:460] Webserver started at http://127.10.249.190:46005/ using document root <none> and password file <none>
I20260810 04:13:13.198973 22990 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:13.199029 22990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:13:13.199143 22990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:13:13 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335193, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:13.260644 22990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "86c81beb22dc4b098afa0b79303474ff"
format_stamp: "Formatted at 2026-08-10 04:13:13 on dist-test-slave-0kls"
server_key: "d7b41da01657c9c0e26e419d2d393008"
server_key_iv: "0dbf0e9d687b7a76f178243cddd83ec7"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:13.261085 22990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "86c81beb22dc4b098afa0b79303474ff"
format_stamp: "Formatted at 2026-08-10 04:13:13 on dist-test-slave-0kls"
server_key: "d7b41da01657c9c0e26e419d2d393008"
server_key_iv: "0dbf0e9d687b7a76f178243cddd83ec7"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:13.262672 22990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:13:13.278220 23006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:13.280440 22990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260810 04:13:13.280582 22990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "86c81beb22dc4b098afa0b79303474ff"
format_stamp: "Formatted at 2026-08-10 04:13:13 on dist-test-slave-0kls"
server_key: "d7b41da01657c9c0e26e419d2d393008"
server_key_iv: "0dbf0e9d687b7a76f178243cddd83ec7"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:13.280685 22990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:13.290354 22990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:13.292515 22990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:13.292678 22990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:13.302840 22990 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:43005
I20260810 04:13:13.302970 23061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:43005 every 8 connection(s)
I20260810 04:13:13.303375 22990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:13:13.304487 23062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:13:13.307670 23062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff: Bootstrap starting.
I20260810 04:13:13.308709 23062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff: Neither blocks nor log segments found. Creating new log.
I20260810 04:13:13.309360 23062 log.cc:824] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:13.310362 23062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff: No bootstrap required, opened a new log
I20260810 04:13:13.310539 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 22990
I20260810 04:13:13.310644 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:13:13.310818 11238 external_mini_cluster.cc:1428] Setting key fd9e378a3c7de3eac8446bb707131a22
I20260810 04:13:13.315325 23062 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86c81beb22dc4b098afa0b79303474ff" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43005 } }
I20260810 04:13:13.315497 23062 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:13:13.315526 23062 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c81beb22dc4b098afa0b79303474ff, State: Initialized, Role: FOLLOWER
I20260810 04:13:13.315640 23062 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86c81beb22dc4b098afa0b79303474ff" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43005 } }
I20260810 04:13:13.315723 23062 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:13:13.315793 23062 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:13:13.315898 23062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:13:13.316839 23062 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86c81beb22dc4b098afa0b79303474ff" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43005 } }
I20260810 04:13:13.316969 23062 leader_election.cc:302] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86c81beb22dc4b098afa0b79303474ff; no voters:
I20260810 04:13:13.317123 23062 leader_election.cc:288] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:13:13.317231 23067 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:13:13.317528 23062 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:13:13.317587 23067 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [term 1 LEADER]: Becoming Leader. State: Replica: 86c81beb22dc4b098afa0b79303474ff, State: Running, Role: LEADER
I20260810 04:13:13.318176 23067 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86c81beb22dc4b098afa0b79303474ff" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43005 } }
I20260810 04:13:13.318746 23069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86c81beb22dc4b098afa0b79303474ff. Latest consensus state: current_term: 1 leader_uuid: "86c81beb22dc4b098afa0b79303474ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86c81beb22dc4b098afa0b79303474ff" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43005 } } }
I20260810 04:13:13.318838 23069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [sys.catalog]: This master's current role is: LEADER
I20260810 04:13:13.318955 23068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86c81beb22dc4b098afa0b79303474ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86c81beb22dc4b098afa0b79303474ff" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43005 } } }
I20260810 04:13:13.319047 23068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff [sys.catalog]: This master's current role is: LEADER
I20260810 04:13:13.319286 23074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 10 04:13:13 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:13.321986 23074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:13:13.322443 23062 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 04:13:13.329139 23074 catalog_manager.cc:1347] Generated new cluster ID: 903877d2c27f4a4791b9cf0fa2a9b259
I20260810 04:13:13.329137 23066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:13.311586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39594 (local address 127.10.249.190:43005)
0810 04:13:13.311999 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:13.312009 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:13.312108 (+ 99us) server_negotiation.cc:407] Connection header received
0810 04:13:13.313044 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:13.313054 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:13.313117 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:13.313295 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:13.313942 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:13.315697 (+ 1755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:13.316540 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:13.317298 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:13.317475 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:13.320596 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:13.320601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:13.320601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:13.320615 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:13.325740 (+ 5125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:13.326545 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:13.326549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:13.326550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:13.327131 (+ 581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:13.327421 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:13.327422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:13.327423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:13.328377 (+ 954us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:13.328536 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:13.328659 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 04:13:13.328837 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":196,"threads_started":1}
I20260810 04:13:13.329231 23074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:13:13.375522 23074 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:13:13.376201 23074 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:13:13.380544 23074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff: Generated new TSK 0
I20260810 04:13:13.380785 23074 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:13:14.156282 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:48563/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43005
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:14.299103 23108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:14.299357 23108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:14.299387 23108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:14.300815 23108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:14.300884 23108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:14.300930 23108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:13:14.302644 23108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.249.148:48563/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:14.302851 23108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:14.303155 23108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:14.310213 23115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:14.310384 23113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:14.310230 23118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:14.310900 23108 server_base.cc:1034] running on GCE node
I20260810 04:13:14.311173 23108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:14.311415 23108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:14.312587 23108 hybrid_clock.cc:648] HybridClock initialized: now 1786335194312548 us; error 35 us; skew 500 ppm
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:14.316039 23108 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:13:14.316562 23108 webserver.cc:460] Webserver started at http://127.10.249.129:44187/ using document root <none> and password file <none>
I20260810 04:13:14.316799 23108 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:14.316864 23108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:13:14.316993 23108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:14.331662 23108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "fdc6cd70d6e64615ac06c5bfca927380"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "2aa7b1eb82bb86e18d19d649b124f12f"
server_key_iv: "324a4c999f439697285281ead3e2e780"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.332361 23108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "fdc6cd70d6e64615ac06c5bfca927380"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "2aa7b1eb82bb86e18d19d649b124f12f"
server_key_iv: "324a4c999f439697285281ead3e2e780"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.334812 23108 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260810 04:13:14.347625 23125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:14.347817 23108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:13:14.347900 23108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "fdc6cd70d6e64615ac06c5bfca927380"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "2aa7b1eb82bb86e18d19d649b124f12f"
server_key_iv: "324a4c999f439697285281ead3e2e780"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.347981 23108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:14.371886 23108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:14.374189 23108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:14.374320 23108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:14.374663 23108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:14.375038 23108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:14.375087 23108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:14.375116 23108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:14.375137 23108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:14.391904 23108 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:40117
I20260810 04:13:14.392344 23108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:13:14.393070 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 23108
I20260810 04:13:14.393199 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:13:14.393383 11238 external_mini_cluster.cc:1428] Setting key 008d9bc1a891accba733fc639b0edb05
I20260810 04:13:14.399488 23246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:40117 every 8 connection(s)
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:14.415614 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:14.399682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43005 (local address 127.10.249.129:44219)
0810 04:13:14.400053 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:14.400099 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:14.400795 (+ 696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:14.402518 (+ 1723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:14.402534 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:14.402947 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:14.403397 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:14.403405 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:14.405113 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:14.405115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:14.406554 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:14.406557 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:14.407167 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:14.407168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:14.407387 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:14.408110 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:14.408120 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:14.412019 (+ 3899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:14.413988 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:14.413994 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:14.413997 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:14.414257 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:14.414480 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:14.414481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:14.414481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:14.414614 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:14.414937 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:14.414944 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:14.415094 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 04:13:14.415197 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 04:13:14.415337 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":239,"threads_started":1}
I20260810 04:13:14.415961 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:14.400144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:44219 (local address 127.10.249.190:43005)
0810 04:13:14.402302 (+ 2158us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:14.402304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:14.402311 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:13:14.402331 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:14.402331 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:14.402341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:14.402423 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:14.404099 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:14.404962 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:14.406695 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:14.407002 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:14.407092 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:14.412131 (+ 5039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:14.412133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:14.412133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:14.412140 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:14.413899 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:14.414335 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:14.414336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:14.414336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:14.414412 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:14.414702 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:14.414703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:14.414703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:14.414837 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:14.414912 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:14.415767 (+ 855us) server_negotiation.cc:299] Negotiation successful
0810 04:13:14.415862 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2139,"thread_start_us":78,"threads_started":1}
I20260810 04:13:14.416452 23247 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43005
I20260810 04:13:14.416566 23247 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:14.416790 23247 heartbeater.cc:511] Master 127.10.249.190:43005 requested a full tablet report, sending...
I20260810 04:13:14.417369 23025 ts_manager.cc:194] Registered new tserver with Master: fdc6cd70d6e64615ac06c5bfca927380 (127.10.249.129:40117)
I20260810 04:13:14.418216 23025 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:44219
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:13:14.430604 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:48563/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43005
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:14.594024 23254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:14.594298 23254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:14.594333 23254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:14.595875 23254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:14.595929 23254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:14.595964 23254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:13:14.597867 23254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.249.148:48563/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:14.598069 23254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:14.598289 23254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:14.605655 23262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:14.605985 23261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:14.606227 23264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:14.608491 23254 server_base.cc:1034] running on GCE node
I20260810 04:13:14.608736 23254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:14.608986 23254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:14.610152 23254 hybrid_clock.cc:648] HybridClock initialized: now 1786335194610134 us; error 25 us; skew 500 ppm
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:14.613897 23254 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:13:14.614336 23254 webserver.cc:460] Webserver started at http://127.10.249.130:34523/ using document root <none> and password file <none>
I20260810 04:13:14.614565 23254 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:14.614617 23254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:13:14.614727 23254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:14.629177 23254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "06a9a34c8459461892efa6a207120fbc"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "2703d1d0bf93bb2ac11ea09f70e2f6d4"
server_key_iv: "eed54711f126864a1b791fdc0f65b550"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.629721 23254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "06a9a34c8459461892efa6a207120fbc"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "2703d1d0bf93bb2ac11ea09f70e2f6d4"
server_key_iv: "eed54711f126864a1b791fdc0f65b550"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.632913 23254 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 04:13:14.644176 23271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:14.644372 23254 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:13:14.644450 23254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "06a9a34c8459461892efa6a207120fbc"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "2703d1d0bf93bb2ac11ea09f70e2f6d4"
server_key_iv: "eed54711f126864a1b791fdc0f65b550"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.644528 23254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:14.680239 23254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:14.682770 23254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:14.682917 23254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:14.683223 23254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:14.683794 23254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:14.683844 23254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:14.683879 23254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:14.683895 23254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:14.703997 23254 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:36695
I20260810 04:13:14.704618 23254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:13:14.705770 23394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:36695 every 8 connection(s)
I20260810 04:13:14.708797 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 23254
I20260810 04:13:14.708918 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:13:14.709079 11238 external_mini_cluster.cc:1428] Setting key 0d29fbfa95b99100eb348ab55ac8dcfe
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
I20260810 04:13:14.723199 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:14.711075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:55797 (local address 127.10.249.190:43005)
0810 04:13:14.712218 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:14.712220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:14.712606 (+ 386us) server_negotiation.cc:407] Connection header received
0810 04:13:14.713467 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:14.713468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:14.713481 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:14.713539 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:14.714651 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:14.715369 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:14.716778 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:14.717112 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:14.717150 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:14.720082 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:14.720084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:14.720084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:14.720091 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:14.721743 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:14.722230 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:14.722232 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:14.722232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:14.722282 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:14.722512 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:14.722513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:14.722513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:14.722640 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:14.722708 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:14.723031 (+ 323us) server_negotiation.cc:299] Negotiation successful
0810 04:13:14.723107 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1110}
I20260810 04:13:14.723738 23397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:14.710663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43005 (local address 127.10.249.130:55797)
0810 04:13:14.712452 (+ 1789us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:14.712498 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:14.713363 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:14.713702 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:14.713707 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:14.714128 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:14.714541 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:14.714547 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:14.715454 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:14.715455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:14.716687 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:14.716690 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:14.717253 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:14.717254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:14.717423 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:14.718078 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:14.718089 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:14.719970 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:14.721879 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:14.721885 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:14.721888 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:14.722149 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:14.722346 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:14.722347 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:14.722347 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:14.722450 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:14.722739 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:14.722744 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:14.722907 (+ 163us) client_negotiation.cc:769] Sending connection context
0810 04:13:14.723318 (+ 411us) client_negotiation.cc:240] Negotiation successful
0810 04:13:14.723456 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1723,"thread_start_us":205,"threads_started":1}
I20260810 04:13:14.724229 23395 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43005
I20260810 04:13:14.724357 23395 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:14.724565 23395 heartbeater.cc:511] Master 127.10.249.190:43005 requested a full tablet report, sending...
I20260810 04:13:14.724910 23025 ts_manager.cc:194] Registered new tserver with Master: 06a9a34c8459461892efa6a207120fbc (127.10.249.130:36695)
I20260810 04:13:14.725385 23025 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:55797
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:13:14.745110 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:48563/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43005
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:14.905167 23401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:14.905416 23401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:14.905445 23401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:14.907158 23401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:14.907214 23401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:14.907249 23401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:13:14.909310 23401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.249.148:48563/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:14.909530 23401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:14.909854 23401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:14.917606 23407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:14.917615 23406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:14.917953 23409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:14.919085 23401 server_base.cc:1034] running on GCE node
I20260810 04:13:14.919275 23401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:14.919540 23401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:14.920737 23401 hybrid_clock.cc:648] HybridClock initialized: now 1786335194920693 us; error 47 us; skew 500 ppm
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:14.924561 23401 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:13:14.925011 23401 webserver.cc:460] Webserver started at http://127.10.249.131:34081/ using document root <none> and password file <none>
I20260810 04:13:14.925239 23401 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:14.925292 23401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:13:14.925405 23401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:13:14 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:14.938068 23401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "724c7e396a444a5590237b50946c6460"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "5ba5e1abd159a07f120f00b57aa9e0de"
server_key_iv: "57123361c04ea654ca76a32e6bcdaab6"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.938517 23401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "724c7e396a444a5590237b50946c6460"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "5ba5e1abd159a07f120f00b57aa9e0de"
server_key_iv: "57123361c04ea654ca76a32e6bcdaab6"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.940729 23401 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260810 04:13:14.970330 23416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:14.972815 23401 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260810 04:13:14.972981 23401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "724c7e396a444a5590237b50946c6460"
format_stamp: "Formatted at 2026-08-10 04:13:14 on dist-test-slave-0kls"
server_key: "5ba5e1abd159a07f120f00b57aa9e0de"
server_key_iv: "57123361c04ea654ca76a32e6bcdaab6"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:14.973129 23401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:15.003683 23401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:15.006434 23401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:15.006635 23401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:15.007159 23401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:15.007732 23401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:15.007818 23401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:15.007864 23401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:15.007896 23401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:15.025991 23401 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:33433
I20260810 04:13:15.026172 23539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:33433 every 8 connection(s)
I20260810 04:13:15.026327 23401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:13:15.027387 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 23401
I20260810 04:13:15.027558 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:13:15.027819 11238 external_mini_cluster.cc:1428] Setting key 718fcb81fb738a5538252a9f5083caf4
Aug 10 04:13:15 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:15.038921 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.027296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:55869 (local address 127.10.249.190:43005)
0810 04:13:15.027341 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:15.027344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:15.028377 (+ 1033us) server_negotiation.cc:407] Connection header received
0810 04:13:15.029626 (+ 1249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:15.029626 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:15.029637 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:15.029674 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:15.031092 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.031535 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.033153 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.033332 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.033385 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.036299 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:15.036300 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:15.036301 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:15.036308 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:15.037627 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:15.038035 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:15.038036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:15.038036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:15.038094 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:15.038323 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:15.038323 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:15.038324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:15.038418 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:15.038479 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:15.038741 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 04:13:15.038839 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:13:15.039315 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.027300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43005 (local address 127.10.249.131:55869)
0810 04:13:15.028140 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:15.028202 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:15.029481 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:15.029892 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:15.029897 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:15.030473 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:15.030974 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.030982 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.031636 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.031637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.033064 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.033067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.033418 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.033420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.033667 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.034397 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:15.034407 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:15.036203 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:15.037706 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:15.037712 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:15.037714 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:15.037968 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:15.038153 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:15.038154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:15.038154 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:15.038259 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:15.038482 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:15.038488 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:15.038611 (+ 123us) client_negotiation.cc:769] Sending connection context
0810 04:13:15.038711 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 04:13:15.038843 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"thread_start_us":175,"threads_started":1}
I20260810 04:13:15.039870 23540 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43005
I20260810 04:13:15.040014 23540 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:15.040282 23540 heartbeater.cc:511] Master 127.10.249.190:43005 requested a full tablet report, sending...
I20260810 04:13:15.040835 23025 ts_manager.cc:194] Registered new tserver with Master: 724c7e396a444a5590237b50946c6460 (127.10.249.131:33433)
I20260810 04:13:15.041193 23025 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:55869
I20260810 04:13:15.050580 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:13:15.058108 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.052094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39602 (local address 127.10.249.190:43005)
0810 04:13:15.052126 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:15.052128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:15.052431 (+ 303us) server_negotiation.cc:407] Connection header received
0810 04:13:15.052498 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:15.052498 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:15.052508 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:15.052564 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:15.053133 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.053721 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.054406 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.054597 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.054665 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.055897 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:15.055899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:15.055899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:15.055905 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:15.057140 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:15.057430 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:15.057431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:15.057432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:15.057481 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:15.057657 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:15.057657 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:15.057658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:15.057748 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:15.057868 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:15.057957 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 04:13:15.058023 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260810 04:13:15.059655 23025 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:13:15.061354 23025 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:13:15.068913 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.064138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:40117 (local address 127.0.0.1:43692)
0810 04:13:15.064671 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:15.064677 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:15.064730 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:15.065138 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:15.065142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:15.065145 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:15.065204 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.065206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.066565 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.066566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.067677 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.067679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.068652 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.068652 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.068734 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.068745 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 04:13:15.068803 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 04:13:15.068847 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":2,"thread_start_us":119,"threads_started":1}
I20260810 04:13:15.069218 23555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.064427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43692 (local address 127.10.249.129:40117)
0810 04:13:15.064836 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:15.064840 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:15.064857 (+ 17us) server_negotiation.cc:407] Connection header received
0810 04:13:15.064892 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:15.064893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:15.064907 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:15.064996 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:15.065265 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.066469 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.067764 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.068437 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.068483 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.068555 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:15.069096 (+ 541us) server_negotiation.cc:299] Negotiation successful
0810 04:13:15.069132 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":67,"threads_started":1}
I20260810 04:13:15.070123 23552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.064224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:36695 (local address 127.0.0.1:57702)
0810 04:13:15.065538 (+ 1314us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:15.065556 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:15.065640 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:15.066014 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:15.066015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:15.066017 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:15.066059 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.066061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.067428 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.067429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.068436 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.068439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.069837 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.069838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.069937 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.069941 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:13:15.069996 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 04:13:15.070059 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1253,"thread_start_us":152,"threads_started":1}
I20260810 04:13:15.070043 23177 tablet_service.cc:1467] Processing CreateTablet for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb (DEFAULT_TABLE table=test-table [id=addf48fc66ee49ecbbb8872634fb5f43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:13:15.070417 23177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:13:15.070473 23556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.064755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57702 (local address 127.10.249.130:36695)
0810 04:13:15.065199 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:15.065203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:15.065637 (+ 434us) server_negotiation.cc:407] Connection header received
0810 04:13:15.065804 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:15.065806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:15.065822 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:15.065894 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:15.066128 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.067353 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.068628 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.069548 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.069715 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.069783 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:15.070298 (+ 515us) server_negotiation.cc:299] Negotiation successful
0810 04:13:15.070338 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":131,"threads_started":1}
I20260810 04:13:15.071383 23323 tablet_service.cc:1467] Processing CreateTablet for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb (DEFAULT_TABLE table=test-table [id=addf48fc66ee49ecbbb8872634fb5f43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:13:15.071753 23323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:13:15.072532 23553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.064138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:33433 (local address 127.0.0.1:48226)
0810 04:13:15.064427 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:15.064463 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:15.064521 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:15.066136 (+ 1615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:15.066137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:15.066140 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:15.066258 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.066261 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.068107 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.068108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.071076 (+ 2968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.071079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.072260 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.072261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.072375 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.072379 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:13:15.072424 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 04:13:15.072455 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":113,"threads_started":1}
I20260810 04:13:15.072623 23557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.064809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48226 (local address 127.10.249.131:33433)
0810 04:13:15.065865 (+ 1056us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:15.065875 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:15.065886 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:13:15.065961 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:15.065963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:15.065992 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:15.066344 (+ 352us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:15.066415 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.067928 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.071296 (+ 3368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.072161 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.072364 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.072424 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:15.072450 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 04:13:15.072484 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":969,"thread_start_us":174,"threads_started":1}
I20260810 04:13:15.073387 23466 tablet_service.cc:1467] Processing CreateTablet for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb (DEFAULT_TABLE table=test-table [id=addf48fc66ee49ecbbb8872634fb5f43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:13:15.073802 23466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:13:15.074605 23558 tablet_bootstrap.cc:492] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380: Bootstrap starting.
I20260810 04:13:15.076056 23558 tablet_bootstrap.cc:654] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380: Neither blocks nor log segments found. Creating new log.
I20260810 04:13:15.077006 23558 log.cc:824] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:15.078042 23558 tablet_bootstrap.cc:492] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380: No bootstrap required, opened a new log
I20260810 04:13:15.078120 23558 ts_tablet_manager.cc:1397] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 04:13:15.079100 23561 tablet_bootstrap.cc:492] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Bootstrap starting.
I20260810 04:13:15.081530 23561 tablet_bootstrap.cc:654] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Neither blocks nor log segments found. Creating new log.
I20260810 04:13:15.082002 23558 raft_consensus.cc:348] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.082185 23558 raft_consensus.cc:374] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:13:15.082229 23558 raft_consensus.cc:729] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc6cd70d6e64615ac06c5bfca927380, State: Initialized, Role: FOLLOWER
I20260810 04:13:15.082149 23560 tablet_bootstrap.cc:492] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Bootstrap starting.
I20260810 04:13:15.082368 23558 consensus_queue.cc:260] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.082707 23561 log.cc:824] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:15.082780 23558 ts_tablet_manager.cc:1428] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260810 04:13:15.082916 23247 heartbeater.cc:503] Master 127.10.249.190:43005 was elected leader, sending a full tablet report...
I20260810 04:13:15.084225 23561 tablet_bootstrap.cc:492] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: No bootstrap required, opened a new log
I20260810 04:13:15.084324 23560 tablet_bootstrap.cc:654] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Neither blocks nor log segments found. Creating new log.
I20260810 04:13:15.084340 23561 ts_tablet_manager.cc:1397] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 04:13:15.084980 23560 log.cc:824] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:15.085752 23560 tablet_bootstrap.cc:492] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: No bootstrap required, opened a new log
I20260810 04:13:15.085847 23560 ts_tablet_manager.cc:1397] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 04:13:15.088613 23560 raft_consensus.cc:348] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.088793 23560 raft_consensus.cc:374] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:13:15.088840 23560 raft_consensus.cc:729] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a9a34c8459461892efa6a207120fbc, State: Initialized, Role: FOLLOWER
I20260810 04:13:15.088958 23560 consensus_queue.cc:260] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.089128 23561 raft_consensus.cc:348] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.089318 23560 ts_tablet_manager.cc:1428] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:13:15.089367 23561 raft_consensus.cc:374] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:13:15.089427 23561 raft_consensus.cc:729] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 724c7e396a444a5590237b50946c6460, State: Initialized, Role: FOLLOWER
I20260810 04:13:15.089442 23395 heartbeater.cc:503] Master 127.10.249.190:43005 was elected leader, sending a full tablet report...
I20260810 04:13:15.089629 23561 consensus_queue.cc:260] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.090126 23561 ts_tablet_manager.cc:1428] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 04:13:15.090341 23540 heartbeater.cc:503] Master 127.10.249.190:43005 was elected leader, sending a full tablet report...
W20260810 04:13:15.150398 23248 tablet.cc:2369] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:13:15.211652 23396 tablet.cc:2369] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 04:13:15 dist-test-slave-0kls krb5kdc[22516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:15.263706 23565 raft_consensus.cc:482] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:13:15.263872 23565 raft_consensus.cc:504] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.264353 23565 leader_election.cc:288] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdc6cd70d6e64615ac06c5bfca927380 (127.10.249.129:40117), 724c7e396a444a5590237b50946c6460 (127.10.249.131:33433)
I20260810 04:13:15.271834 23557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.264714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:41499 (local address 127.10.249.131:33433)
0810 04:13:15.264761 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:15.264763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:15.267979 (+ 3216us) server_negotiation.cc:407] Connection header received
0810 04:13:15.268123 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:15.268124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:15.268134 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:15.268163 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:15.268479 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.269227 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.270868 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.271409 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.271467 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.271478 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:15.271717 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 04:13:15.271761 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:13:15.273108 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.264517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:33433 (local address 127.10.249.130:41499)
0810 04:13:15.266769 (+ 2252us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:15.266782 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:15.268016 (+ 1234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:15.268231 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:15.268232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:15.268233 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:15.268384 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.268387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.269354 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.269355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.270734 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.270738 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.271549 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.271550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.271623 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.271627 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:13:15.272892 (+ 1265us) client_negotiation.cc:240] Negotiation successful
0810 04:13:15.272942 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2232,"thread_start_us":68,"threads_started":1}
I20260810 04:13:15.273765 23487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a9ddb0d23d74a6caae16dc63fb04bcb" candidate_uuid: "06a9a34c8459461892efa6a207120fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "724c7e396a444a5590237b50946c6460" is_pre_election: true
I20260810 04:13:15.273984 23487 raft_consensus.cc:2454] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a9a34c8459461892efa6a207120fbc in term 0.
I20260810 04:13:15.274391 23273 leader_election.cc:302] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a9a34c8459461892efa6a207120fbc, 724c7e396a444a5590237b50946c6460; no voters:
I20260810 04:13:15.274545 23565 raft_consensus.cc:2781] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:13:15.274593 23565 raft_consensus.cc:482] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:13:15.274617 23565 raft_consensus.cc:3037] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:13:15.276129 23565 raft_consensus.cc:504] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.276296 23565 leader_election.cc:288] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [CANDIDATE]: Term 1 election: Requested vote from peers fdc6cd70d6e64615ac06c5bfca927380 (127.10.249.129:40117), 724c7e396a444a5590237b50946c6460 (127.10.249.131:33433)
W20260810 04:13:15.277309 23541 tablet.cc:2369] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:13:15.277751 23487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a9ddb0d23d74a6caae16dc63fb04bcb" candidate_uuid: "06a9a34c8459461892efa6a207120fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "724c7e396a444a5590237b50946c6460"
I20260810 04:13:15.277854 23487 raft_consensus.cc:3037] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:13:15.279186 23487 raft_consensus.cc:2454] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a9a34c8459461892efa6a207120fbc in term 1.
I20260810 04:13:15.279415 23273 leader_election.cc:302] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a9a34c8459461892efa6a207120fbc, 724c7e396a444a5590237b50946c6460; no voters:
I20260810 04:13:15.280339 23565 raft_consensus.cc:2781] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:13:15.280505 23565 raft_consensus.cc:686] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 1 LEADER]: Becoming Leader. State: Replica: 06a9a34c8459461892efa6a207120fbc, State: Running, Role: LEADER
I20260810 04:13:15.280733 23565 consensus_queue.cc:237] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } }
I20260810 04:13:15.281831 23025 catalog_manager.cc:5495] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a9a34c8459461892efa6a207120fbc (127.10.249.130). New cstate: current_term: 1 leader_uuid: "06a9a34c8459461892efa6a207120fbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a9a34c8459461892efa6a207120fbc" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 36695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 } health_report { overall_health: UNKNOWN } } }
I20260810 04:13:15.282027 23555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.264857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:55209 (local address 127.10.249.129:40117)
0810 04:13:15.264906 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:15.264909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:15.264945 (+ 36us) server_negotiation.cc:407] Connection header received
0810 04:13:15.265052 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:15.265053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:15.265063 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:15.265093 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:15.278209 (+ 13116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.278985 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.280706 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.281510 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.281570 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.281580 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:15.281909 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 04:13:15.281957 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:13:15.282418 23567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.264489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:40117 (local address 127.10.249.130:55209)
0810 04:13:15.264876 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:15.264887 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:15.264976 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:15.277820 (+ 12844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:15.277821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:15.277825 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:15.278095 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.278097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.279171 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.279171 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.280596 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:15.280599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.281667 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.281668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:15.281818 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.281823 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:13:15.282145 (+ 322us) client_negotiation.cc:240] Negotiation successful
0810 04:13:15.282187 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":103,"threads_started":1}
I20260810 04:13:15.283128 23198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a9ddb0d23d74a6caae16dc63fb04bcb" candidate_uuid: "06a9a34c8459461892efa6a207120fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6cd70d6e64615ac06c5bfca927380"
I20260810 04:13:15.283180 23192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a9ddb0d23d74a6caae16dc63fb04bcb" candidate_uuid: "06a9a34c8459461892efa6a207120fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc6cd70d6e64615ac06c5bfca927380" is_pre_election: true
I20260810 04:13:15.283263 23198 raft_consensus.cc:3037] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:13:15.285341 23198 raft_consensus.cc:2454] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a9a34c8459461892efa6a207120fbc in term 1.
I20260810 04:13:15.295825 23556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.292092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57708 (local address 127.10.249.130:36695)
0810 04:13:15.292285 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:15.292287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:15.292295 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:13:15.292334 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:15.292335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:15.292360 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:15.292467 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:13:15.292667 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.293384 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.294569 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:15.294874 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:15.294929 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:15.295190 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:13:15.295312 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:13:15.295388 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:15.295616 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 04:13:15.295636 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260810 04:13:15.298190 23487 raft_consensus.cc:1261] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 1 FOLLOWER]: Refusing update from remote peer 06a9a34c8459461892efa6a207120fbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:13:15.298225 23198 raft_consensus.cc:1261] T 8a9ddb0d23d74a6caae16dc63fb04bcb P fdc6cd70d6e64615ac06c5bfca927380 [term 1 FOLLOWER]: Refusing update from remote peer 06a9a34c8459461892efa6a207120fbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:13:15.298586 23569 consensus_queue.cc:1035] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc6cd70d6e64615ac06c5bfca927380" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 40117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:13:15.298699 23565 consensus_queue.cc:1035] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "724c7e396a444a5590237b50946c6460" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 33433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:13:15.306170 23574 mvcc.cc:205] Tried to move back new op lower bound from 7316828959938306048 to 7316828959870586880. Current Snapshot: MvccSnapshot[applied={T|T < 7316828959938306048}]
I20260810 04:13:15.309413 23025 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:13:15.309505 23025 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:13:15.310509 23025 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86c81beb22dc4b098afa0b79303474ff: Sending DeleteTablet for 3 replicas of tablet 8a9ddb0d23d74a6caae16dc63fb04bcb
I20260810 04:13:15.310954 23177 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:13:15 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:43692
I20260810 04:13:15.311357 23466 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:13:15 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:48226
I20260810 04:13:15.311376 23323 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:13:15 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:57702
I20260810 04:13:15.311854 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 23108
I20260810 04:13:15.316829 23584 tablet_replica.cc:330] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: stopping tablet replica
I20260810 04:13:15.317039 23584 raft_consensus.cc:2229] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:13:15.317312 23584 raft_consensus.cc:2258] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:13:15.318140 23584 ts_tablet_manager.cc:1905] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:13:15.320950 23585 tablet_replica.cc:330] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: stopping tablet replica
I20260810 04:13:15.321167 23585 raft_consensus.cc:2229] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:13:15.321408 23585 raft_consensus.cc:2258] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:13:15.322038 23585 ts_tablet_manager.cc:1905] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:13:15.324391 23585 ts_tablet_manager.cc:1918] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:13:15.324522 23585 log.cc:1196] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/8a9ddb0d23d74a6caae16dc63fb04bcb
I20260810 04:13:15.324847 23585 ts_tablet_manager.cc:1939] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 06a9a34c8459461892efa6a207120fbc: Deleting consensus metadata
I20260810 04:13:15.325126 23584 ts_tablet_manager.cc:1918] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:13:15.325207 23584 log.cc:1196] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/8a9ddb0d23d74a6caae16dc63fb04bcb
I20260810 04:13:15.325666 23009 catalog_manager.cc:4841] TS 06a9a34c8459461892efa6a207120fbc (127.10.249.130:36695): tablet 8a9ddb0d23d74a6caae16dc63fb04bcb (table test-table [id=addf48fc66ee49ecbbb8872634fb5f43]) successfully deleted
I20260810 04:13:15.325814 23584 ts_tablet_manager.cc:1939] T 8a9ddb0d23d74a6caae16dc63fb04bcb P 724c7e396a444a5590237b50946c6460: Deleting consensus metadata
I20260810 04:13:15.326256 23008 catalog_manager.cc:4841] TS 724c7e396a444a5590237b50946c6460 (127.10.249.131:33433): tablet 8a9ddb0d23d74a6caae16dc63fb04bcb (table test-table [id=addf48fc66ee49ecbbb8872634fb5f43]) successfully deleted
W20260810 04:13:15.326349 23007 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:40117 (error 108)
I20260810 04:13:15.326893 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:15.326776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:40117 (local address 127.0.0.1:43706)
0810 04:13:15.326820 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:15.326859 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:40117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260810 04:13:15.327025 23007 catalog_manager.cc:4584] TS fdc6cd70d6e64615ac06c5bfca927380 (127.10.249.129:40117): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8a9ddb0d23d74a6caae16dc63fb04bcb: Network error: Client connection negotiation failed: client connection to 127.10.249.129:40117: connect: Connection refused (error 111)
I20260810 04:13:15.327067 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 23254
I20260810 04:13:15.333244 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 23401
I20260810 04:13:15.340579 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 22990
I20260810 04:13:15.346454 11238 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 04:13:15.691370 11238 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 04:13:15.691468 11238 mini_ranger.cc:66] Stopping Ranger...
I20260810 04:13:16.038049 11238 mini_ranger.cc:68] Stopped Ranger
2026-08-10 04:13:16.038 UTC [22548] LOG: received smart shutdown request
2026-08-10 04:13:16.041 UTC [22548] LOG: background worker "logical replication launcher" (PID 22557) exited with exit code 1
2026-08-10 04:13:16.042 UTC [22552] LOG: shutting down
2026-08-10 04:13:16.197 UTC [22548] LOG: database system is shut down
2026-08-10T04:13:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46081 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:13:16 dist-test-slave-0kls krb5kdc[23596](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:13:16 dist-test-slave-0kls krb5kdc[23596](info): set up 2 sockets
Aug 10 04:13:16 dist-test-slave-0kls krb5kdc[23596](info): commencing operation
krb5kdc: starting...
W20260810 04:13:17.306777 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.983s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:13:17 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:13:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:13:17Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.249.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.249.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/rangeradmin_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/rangeradmin_127.10.249.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.249.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.249.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/rangerlookup_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/rangerlookup_127.10.249.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.249.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.249.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/HTTP_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/HTTP_127.10.249.148@KRBTEST.COM.keytab.
I20260810 04:13:17.460762 11238 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZcp64r/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/postgres -l logfile start
2026-08-10 04:13:19.703 UTC [23628] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 04:13:19.703 UTC [23628] LOG: listening on IPv4 address "127.10.249.148", port 53689
2026-08-10 04:13:19.706 UTC [23628] LOG: listening on Unix socket "/tmp/.s.PGSQL.53689"
2026-08-10 04:13:19.727 UTC [23632] LOG: database system was shut down at 2026-08-10 04:13:18 UTC
2026-08-10 04:13:19.730 UTC [23628] LOG: database system is ready to accept connections
I20260810 04:13:20.654273 11238 mini_postgres.cc:96] Postgres bound to 53689
2026-08-10 04:13:20.660 UTC [23642] FATAL: database "slave" does not exist
127.10.249.148:53689 - accepting connections
I20260810 04:13:20.661247 11238 mini_ranger.cc:161] Starting Ranger...
I20260810 04:13:20.675585 11238 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 04:13:21.105275 11238 mini_ranger.cc:87] Created ranger Postgres database
I20260810 04:13:21.105368 11238 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-admin
2026-08-10 04:13:21,373 [I] DB FLAVOR :POSTGRES
2026-08-10 04:13:21,373 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 04:13:21,374 [I] Checking connection..
2026-08-10 04:13:21,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 04:13:21,609 [I] Checking connection passed.
2026-08-10 04:13:21,609 [I] --------- Verifying version history table ---------
2026-08-10 04:13:21,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:13:21,856 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 04:13:21,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:13:22,085 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 04:13:22,085 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 04:13:22,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 04:13:22.324 UTC [23712] WARNING: there is no transaction in progress
2026-08-10 04:13:22,331 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 04:13:22,331 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:13:22,559 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 04:13:22,559 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 04:13:22,560 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 04:13:22,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 04:13:23,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0kls.c.gcp-upstream.internal','N') ;"
2026-08-10 04:13:23,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 04:13:23,522 [I] Table x_portal_user does not exist in database ranger
2026-08-10 04:13:23,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 04:13:23,758 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 04:13:23,758 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 04:13:24,005 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 04:13:24,247 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 04:13:24,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 04:13:25.109 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.123 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.137 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.150 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.163 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.177 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.222 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.228 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.240 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.249 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.258 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.270 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.278 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.284 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.289 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25.295 UTC [23826] WARNING: there is no transaction in progress
2026-08-10 04:13:25,844 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 04:13:25,845 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 04:13:26,056 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 04:13:26,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 04:13:26,294 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 04:13:26,294 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 04:13:26,537 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 04:13:26,538 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 04:13:26,783 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 04:13:27,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0kls.c.gcp-upstream.internal';"
2026-08-10 04:13:27,263 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 04:13:27,264 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 04:13:27,507 [I] DB_PATCHES have already been applied
I20260810 04:13:27.512573 11238 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZcp64r/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 04:13:27.512636 11238 mini_ranger.cc:193] Using host: 127.10.249.148
I20260810 04:13:27.516538 11238 mini_ranger.cc:227] Ranger admin URL: http://127.10.249.148:42771
Aug 10, 2026 4:13:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 4:13:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 4:13:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 4:13:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 4:13:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 4:13:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 4:13:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 04:13:28.584093 11238 mini_ranger.cc:160] Time spent starting Ranger: real 7.923s user 0.003s sys 0.006s
Aug 10, 2026 4:13:46 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 4:13:46 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 4:13:46 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 4:13:46 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 4:13:47 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 04:13:48.190794 11238 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.249.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.249.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/rangerkms_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.249.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/rangerkms_127.10.249.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.249.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.249.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.249.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/HTTP_127.10.249.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.249.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/HTTP_127.10.249.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 04:13:48 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335228, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 04:13:48.281133 11238 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 04:13:48.290248 11238 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 04:13:49.080150 11238 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 04:13:49.080242 11238 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms
I20260810 04:13:49.080261 11238 mini_ranger_kms.cc:227] Using postgres at 127.10.249.148:53689
2026-08-10 04:13:49,249 [I] DB FLAVOR :POSTGRES
2026-08-10 04:13:49,250 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 04:13:49,250 [I] Checking connection
2026-08-10 04:13:49,250 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 04:13:49,465 [I] connection success
2026-08-10 04:13:49,465 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 04:13:49,465 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 04:13:49,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 04:13:49,701 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 04:13:49,701 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 04:13:49,701 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 04:13:49,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.249.148:53689/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 04:13:49,965 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 04:13:50.432219 11238 mini_ranger_kms.cc:310] Created kms service
I20260810 04:13:50.610222 11238 mini_ranger_kms.cc:326] Created kudu user
I20260810 04:13:50.652343 11238 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 04:13:50 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335228, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:51.005009 11238 mini_ranger_kms.cc:384] Added ranger policy
I20260810 04:13:51.005256 11238 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZcp64r/build/release/bin/postgresql.jar:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZcp64r/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 04:13:51.005285 11238 mini_ranger_kms.cc:240] Using host: 127.10.249.148
I20260810 04:13:51.009603 11238 mini_ranger_kms.cc:276] Ranger KMS PID: 24019
I20260810 04:13:51.009677 11238 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.249.148:41187
Aug 10, 2026 4:13:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 4:13:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 4:13:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 4:13:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 4:13:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 4:13:52 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 04:13:53 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786335233, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.249.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:53.185632 11238 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.904s user 0.007s sys 0.148s
I20260810 04:13:53.185742 11238 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 04:13:53.185810 11238 mini_ranger_kms.cc:401] 127.10.249.148:41187/kms/v1/keys
Aug 10 04:13:53 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335233, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.249.148@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
Aug 10 04:13:53 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335233, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.249.148@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
Aug 10 04:13:56 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:13:56.096277 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43853
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:43853
--ranger_config_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:41187/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:56.174615 24072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:56.174803 24072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:56.174823 24072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:56.175961 24072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:13:56.176002 24072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:56.176015 24072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:56.176029 24072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:13:56.176040 24072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:13:56.177616 24072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.249.148:41187/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:43853
--ranger_config_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:56.177852 24072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:56.178108 24072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:56.182819 24077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:56.182819 24078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:56.182827 24080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:56.183223 24072 server_base.cc:1034] running on GCE node
I20260810 04:13:56.183475 24072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:56.183796 24072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:56.184962 24072 hybrid_clock.cc:648] HybridClock initialized: now 1786335236184941 us; error 39 us; skew 500 ppm
Aug 10 04:13:56 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335236, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:56.187319 24072 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:13:56.187764 24072 webserver.cc:460] Webserver started at http://127.10.249.190:34613/ using document root <none> and password file <none>
I20260810 04:13:56.187988 24072 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:56.188043 24072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:13:56.188189 24072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:13:56 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335236, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:56.245968 24072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "eb7d209f277240e98eed19bd3d946520"
format_stamp: "Formatted at 2026-08-10 04:13:56 on dist-test-slave-0kls"
server_key: "b786269e8baf87a36b631d1f6098af09"
server_key_iv: "b74de47c4d5e28562f93ef75e6b3f440"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:56.246372 24072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "eb7d209f277240e98eed19bd3d946520"
format_stamp: "Formatted at 2026-08-10 04:13:56 on dist-test-slave-0kls"
server_key: "b786269e8baf87a36b631d1f6098af09"
server_key_iv: "b74de47c4d5e28562f93ef75e6b3f440"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:56.247747 24072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:13:56.258237 24088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:56.258419 24072 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:13:56.258514 24072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "eb7d209f277240e98eed19bd3d946520"
format_stamp: "Formatted at 2026-08-10 04:13:56 on dist-test-slave-0kls"
server_key: "b786269e8baf87a36b631d1f6098af09"
server_key_iv: "b74de47c4d5e28562f93ef75e6b3f440"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:56.258618 24072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:56.267278 24072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:56.269045 24072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:56.269200 24072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:56.274246 24072 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:43853
I20260810 04:13:56.274284 24144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:43853 every 8 connection(s)
I20260810 04:13:56.274616 24072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:13:56.275439 24145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:13:56.278342 24145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Bootstrap starting.
I20260810 04:13:56.279047 24145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Neither blocks nor log segments found. Creating new log.
I20260810 04:13:56.279353 24145 log.cc:824] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:56.280133 24145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: No bootstrap required, opened a new log
I20260810 04:13:56.282389 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 24072
I20260810 04:13:56.282505 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:13:56.282709 11238 external_mini_cluster.cc:1428] Setting key 9dac0cb4a185ad89414937354ab28523
I20260810 04:13:56.282963 24145 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } }
I20260810 04:13:56.283185 24145 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:13:56.283241 24145 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7d209f277240e98eed19bd3d946520, State: Initialized, Role: FOLLOWER
I20260810 04:13:56.283402 24145 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } }
I20260810 04:13:56.283572 24145 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:13:56.283665 24145 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:13:56.283726 24145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:13:56.284400 24145 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } }
I20260810 04:13:56.284505 24145 leader_election.cc:302] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb7d209f277240e98eed19bd3d946520; no voters:
I20260810 04:13:56.284680 24145 leader_election.cc:288] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:13:56.284718 24151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:13:56.284929 24151 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 1 LEADER]: Becoming Leader. State: Replica: eb7d209f277240e98eed19bd3d946520, State: Running, Role: LEADER
I20260810 04:13:56.284991 24145 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:13:56.285050 24151 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } }
I20260810 04:13:56.285446 24151 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb7d209f277240e98eed19bd3d946520" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } } }
I20260810 04:13:56.285563 24151 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: This master's current role is: LEADER
I20260810 04:13:56.285706 24151 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7d209f277240e98eed19bd3d946520. Latest consensus state: current_term: 1 leader_uuid: "eb7d209f277240e98eed19bd3d946520" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } } }
I20260810 04:13:56.285804 24151 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: This master's current role is: LEADER
I20260810 04:13:56.285939 24160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:13:56.286445 24160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:13:56.286754 24145 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 10 04:13:56 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:56.292912 24160 catalog_manager.cc:1347] Generated new cluster ID: a3d6d735e67d424abd42f1654b1622af
I20260810 04:13:56.293047 24160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:13:56.303567 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:56.283269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58352 (local address 127.10.249.190:43853)
0810 04:13:56.283459 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:56.283469 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:56.283568 (+ 99us) server_negotiation.cc:407] Connection header received
0810 04:13:56.283693 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:56.283699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:56.283787 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:56.283937 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:56.284591 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:56.285951 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:56.286973 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:56.290096 (+ 3123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:56.290309 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:56.294335 (+ 4026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:56.294339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:56.294340 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:56.294351 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:56.296286 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:56.301845 (+ 5559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:56.301849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:56.301849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:56.301966 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:56.302177 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:56.302178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:56.302179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:56.302483 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:56.302641 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:56.303184 (+ 543us) server_negotiation.cc:299] Negotiation successful
0810 04:13:56.303322 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":74,"threads_started":1}
I20260810 04:13:56.311093 24160 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:13:56.311882 24160 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:13:56.321729 24160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Generated new TSK 0
I20260810 04:13:56.322002 24160 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:13:57.024765 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:41187/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43853
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:57.117626 24192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:57.117836 24192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:57.117870 24192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:57.118858 24192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:57.118919 24192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:57.118958 24192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:13:57.120431 24192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.249.148:41187/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:57.120638 24192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:57.120847 24192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:57.126402 24198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:57.126417 24199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:57.126596 24192 server_base.cc:1034] running on GCE node
W20260810 04:13:57.126402 24201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:57.126889 24192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:57.127177 24192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:57.128312 24192 hybrid_clock.cc:648] HybridClock initialized: now 1786335237128301 us; error 28 us; skew 500 ppm
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:57.130836 24192 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:13:57.131270 24192 webserver.cc:460] Webserver started at http://127.10.249.129:41731/ using document root <none> and password file <none>
I20260810 04:13:57.131508 24192 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:57.131572 24192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:13:57.131705 24192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:57.142869 24192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "d3da4adeeb4f48edb134501205c2ed7d"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "d940bb1d605ed85cb83d189e95a120b2"
server_key_iv: "9cc8210e42e1df5f5f9bd0387520e815"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.143288 24192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "d3da4adeeb4f48edb134501205c2ed7d"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "d940bb1d605ed85cb83d189e95a120b2"
server_key_iv: "9cc8210e42e1df5f5f9bd0387520e815"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.145062 24192 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 04:13:57.156771 24209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.156940 24192 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:13:57.157019 24192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "d3da4adeeb4f48edb134501205c2ed7d"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "d940bb1d605ed85cb83d189e95a120b2"
server_key_iv: "9cc8210e42e1df5f5f9bd0387520e815"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.157097 24192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:57.184271 24192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:57.186548 24192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:57.186764 24192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:57.187068 24192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:57.187448 24192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:57.187530 24192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.187614 24192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:57.187696 24192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.194515 24192 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:33869
I20260810 04:13:57.194990 24192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:13:57.195262 24336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:33869 every 8 connection(s)
I20260810 04:13:57.200481 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 24192
I20260810 04:13:57.200585 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:13:57.200784 11238 external_mini_cluster.cc:1428] Setting key f36a91374a74f276921732b4bf8b0a98
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:57.207512 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:57.196176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43853 (local address 127.10.249.129:49245)
0810 04:13:57.197901 (+ 1725us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:57.197944 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:57.198486 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:57.198936 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:57.198940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:57.199168 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:57.199430 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:57.199436 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.200464 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.200466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:57.201536 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:57.201539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.202079 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.202080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:57.202202 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:57.202745 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:57.202755 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:57.204291 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:57.205938 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:57.205944 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:57.205947 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:57.206237 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:57.206439 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:57.206439 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:57.206440 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:57.206555 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:57.206832 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:57.206838 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:57.206986 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 04:13:57.207087 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 04:13:57.207226 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1683,"thread_start_us":85,"threads_started":1}
I20260810 04:13:57.208218 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:57.196464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:49245 (local address 127.10.249.190:43853)
0810 04:13:57.198696 (+ 2232us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:57.198698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:57.198707 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:13:57.198734 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:57.198735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:57.198748 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:57.198811 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:57.199541 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.200361 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.201633 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.201942 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.202001 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:57.204380 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:57.204381 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:57.204382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:57.204388 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:57.205834 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:57.206317 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:57.206319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:57.206319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:57.206379 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:57.206616 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:57.206618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:57.206618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:57.206751 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:57.206807 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:57.208015 (+ 1208us) server_negotiation.cc:299] Negotiation successful
0810 04:13:57.208100 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2188,"thread_start_us":76,"threads_started":1}
I20260810 04:13:57.208742 24337 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43853
I20260810 04:13:57.208827 24337 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:57.208993 24337 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:57.209506 24106 ts_manager.cc:194] Registered new tserver with Master: d3da4adeeb4f48edb134501205c2ed7d (127.10.249.129:33869)
I20260810 04:13:57.210103 24106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:49245
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:13:57.238744 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:41187/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43853
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:57.348748 24343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:57.349040 24343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:57.349108 24343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:57.350680 24343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:57.350778 24343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:57.350950 24343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:13:57.353048 24343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.249.148:41187/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:57.353569 24343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:57.353888 24343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:57.360296 24351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:57.360743 24350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:57.360980 24353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:57.361953 24343 server_base.cc:1034] running on GCE node
I20260810 04:13:57.362255 24343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:57.362497 24343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:57.363777 24343 hybrid_clock.cc:648] HybridClock initialized: now 1786335237363747 us; error 46 us; skew 500 ppm
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:57.366866 24343 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:13:57.367349 24343 webserver.cc:460] Webserver started at http://127.10.249.130:42305/ using document root <none> and password file <none>
I20260810 04:13:57.367570 24343 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:57.367614 24343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:13:57.367724 24343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:57.382254 24343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "c2d7ab705df34a3aa9ada7127b12f311"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "ae096cde069852b3bbf15a0bb4f69c5f"
server_key_iv: "b77cc4f77f1ef86e3b713e419ba45f4c"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.382767 24343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "c2d7ab705df34a3aa9ada7127b12f311"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "ae096cde069852b3bbf15a0bb4f69c5f"
server_key_iv: "b77cc4f77f1ef86e3b713e419ba45f4c"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.386334 24343 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:57.404615 24360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.404835 24343 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260810 04:13:57.404938 24343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "c2d7ab705df34a3aa9ada7127b12f311"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "ae096cde069852b3bbf15a0bb4f69c5f"
server_key_iv: "b77cc4f77f1ef86e3b713e419ba45f4c"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.405030 24343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:57.425570 24343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:57.427852 24343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:57.428022 24343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:57.428236 24343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:57.428617 24343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:57.428711 24343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.428777 24343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:57.428830 24343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.434793 24343 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:34387
I20260810 04:13:57.435271 24343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:13:57.443950 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 24343
I20260810 04:13:57.444046 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:13:57.444213 11238 external_mini_cluster.cc:1428] Setting key 842346f42cb2789991db70219edcb675
I20260810 04:13:57.447116 24485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:34387 every 8 connection(s)
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:57.463393 24489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:57.447714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43853 (local address 127.10.249.130:48413)
0810 04:13:57.450981 (+ 3267us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:57.451027 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:57.451638 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:57.451995 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:57.451999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:57.452224 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:57.452456 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:57.452461 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.453555 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.453556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:57.454793 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:57.454796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.455326 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.455327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:57.455464 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:57.456019 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:57.456029 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:57.459674 (+ 3645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:57.461633 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:57.461639 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:57.461641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:57.461953 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:57.462204 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:57.462205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:57.462205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:57.462341 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:57.462659 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:57.462666 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:57.462834 (+ 168us) client_negotiation.cc:769] Sending connection context
0810 04:13:57.462952 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 04:13:57.463122 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3211,"thread_start_us":113,"threads_started":1}
I20260810 04:13:57.464103 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:57.447993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:48413 (local address 127.10.249.190:43853)
0810 04:13:57.448032 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:57.448034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:57.451107 (+ 3073us) server_negotiation.cc:407] Connection header received
0810 04:13:57.451767 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:57.451768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:57.451783 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:57.451812 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:57.452561 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.453434 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.454892 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.455189 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.455231 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:57.459807 (+ 4576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:57.459808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:57.459808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:57.459816 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:57.461543 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:57.462033 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:57.462034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:57.462034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:57.462101 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:57.462408 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:57.462409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:57.462409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:57.462542 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:57.462619 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:57.463915 (+ 1296us) server_negotiation.cc:299] Negotiation successful
0810 04:13:57.464004 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:13:57.464615 24486 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43853
I20260810 04:13:57.464720 24486 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:57.464901 24486 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:57.465253 24106 ts_manager.cc:194] Registered new tserver with Master: c2d7ab705df34a3aa9ada7127b12f311 (127.10.249.130:34387)
I20260810 04:13:57.465713 24106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:48413
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:13:57.476527 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:41187/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43853
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:57.594884 24491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:57.595233 24491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:57.595322 24491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:57.596933 24491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:57.597039 24491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:57.597292 24491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:13:57.599445 24491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.249.148:41187/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:57.599965 24491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:57.600308 24491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:57.607090 24498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:57.608213 24491 server_base.cc:1034] running on GCE node
W20260810 04:13:57.609511 24500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:57.610175 24497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:57.610469 24491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:57.610720 24491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:57.611877 24491 hybrid_clock.cc:648] HybridClock initialized: now 1786335237611855 us; error 34 us; skew 500 ppm
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:57.615265 24491 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:13:57.615724 24491 webserver.cc:460] Webserver started at http://127.10.249.131:33429/ using document root <none> and password file <none>
I20260810 04:13:57.615999 24491 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:57.616050 24491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:13:57.616180 24491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:57.637123 24491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "31474d77cff141cb847cf14b75c1a4af"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "9bdaeb2d93eeec460248aa57030bbec8"
server_key_iv: "0825bdb2a4a52b537de9da8a19d680ef"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.638547 24491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "31474d77cff141cb847cf14b75c1a4af"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "9bdaeb2d93eeec460248aa57030bbec8"
server_key_iv: "0825bdb2a4a52b537de9da8a19d680ef"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.641660 24491 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260810 04:13:57.657697 24507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.657966 24491 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:13:57.658121 24491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "31474d77cff141cb847cf14b75c1a4af"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "9bdaeb2d93eeec460248aa57030bbec8"
server_key_iv: "0825bdb2a4a52b537de9da8a19d680ef"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.658288 24491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:57.692948 24491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:57.695438 24491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:57.695619 24491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:57.695873 24491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:57.696295 24491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:57.696385 24491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.696457 24491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:57.696520 24491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.703841 24491 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:46137
I20260810 04:13:57.704151 24626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:46137 every 8 connection(s)
I20260810 04:13:57.704355 24491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:57.713893 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:57.705401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:50717 (local address 127.10.249.190:43853)
0810 04:13:57.705460 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:57.705462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:57.705719 (+ 257us) server_negotiation.cc:407] Connection header received
0810 04:13:57.706420 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:57.706422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:57.706436 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:57.706481 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:57.707033 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.707498 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.708722 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.708934 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.709019 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:57.711187 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:57.711189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:57.711189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:57.711198 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:57.712489 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:57.712912 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:57.712913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:57.712913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:57.712972 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:57.713230 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:57.713231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:57.713232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:57.713340 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:57.713413 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:57.713687 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 04:13:57.713763 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:13:57.714080 24630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:57.705119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43853 (local address 127.10.249.131:50717)
0810 04:13:57.705567 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:57.705617 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:57.706298 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:57.706545 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:57.706548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:57.706741 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:57.706923 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:57.706928 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.707595 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.707596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:57.708627 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:57.708630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:57.709043 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:57.709044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:57.709163 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:57.709686 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:57.709703 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:57.711077 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:57.712582 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:57.712588 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:57.712590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:57.712820 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:57.713039 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:57.713040 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:57.713040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:57.713159 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:57.713415 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:57.713422 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:57.713555 (+ 133us) client_negotiation.cc:769] Sending connection context
0810 04:13:57.713663 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 04:13:57.713840 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":80,"threads_started":1}
I20260810 04:13:57.714497 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 24491
I20260810 04:13:57.714625 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:13:57.714792 11238 external_mini_cluster.cc:1428] Setting key b1f0c107b9c4c66c2862807d292194e2
I20260810 04:13:57.715181 24627 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43853
I20260810 04:13:57.715266 24627 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:57.715432 24627 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:57.715735 24106 ts_manager.cc:194] Registered new tserver with Master: 31474d77cff141cb847cf14b75c1a4af (127.10.249.131:46137)
I20260810 04:13:57.716130 24106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:50717
I20260810 04:13:57.726501 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:13:57.727077 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 24192
I20260810 04:13:57.733978 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 24343
I20260810 04:13:57.741370 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 24491
I20260810 04:13:57.747707 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 24072
I20260810 04:13:57.754261 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43853
--webserver_interface=127.10.249.190
--webserver_port=34613
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:43853
--ranger_config_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:41187/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.249.148:41187/kms with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:13:57.827997 24631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:57.828184 24631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:57.828205 24631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:57.829272 24631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:13:57.829308 24631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:57.829320 24631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:57.829331 24631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:13:57.829381 24631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:13:57.830708 24631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.249.148:41187/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:43853
--ranger_config_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=34613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:57.830858 24631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:57.831063 24631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:57.835558 24637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:57.835565 24636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:57.835580 24639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:57.835729 24631 server_base.cc:1034] running on GCE node
I20260810 04:13:57.835937 24631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:57.836190 24631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:57.837327 24631 hybrid_clock.cc:648] HybridClock initialized: now 1786335237837301 us; error 43 us; skew 500 ppm
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:57.839663 24631 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:13:57.840103 24631 webserver.cc:460] Webserver started at http://127.10.249.190:34613/ using document root <none> and password file <none>
I20260810 04:13:57.840272 24631 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:57.840322 24631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 04:13:57 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335237, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:57.883241 24631 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:13:57.884231 24647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:57.884454 24631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:13:57.884565 24631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "eb7d209f277240e98eed19bd3d946520"
format_stamp: "Formatted at 2026-08-10 04:13:56 on dist-test-slave-0kls"
server_key: "b786269e8baf87a36b631d1f6098af09"
server_key_iv: "b74de47c4d5e28562f93ef75e6b3f440"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:57.884958 24631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:57.899554 24631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:57.901651 24631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:57.901866 24631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:57.905853 24631 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:43853
I20260810 04:13:57.905898 24702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:43853 every 8 connection(s)
I20260810 04:13:57.906262 24631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:13:57.907367 24703 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:13:57.907995 24703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Bootstrap starting.
I20260810 04:13:57.910130 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 24631
I20260810 04:13:57.910457 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:41187/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:33869
--local_ip_for_outbound_sockets=127.10.249.129
--tserver_master_addrs=127.10.249.190:43853
--webserver_port=41731
--webserver_interface=127.10.249.129
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.249.148:41187/kms with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:13:57.916121 24703 log.cc:824] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:57.917573 24703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:13:57.917889 24703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Bootstrap complete.
I20260810 04:13:57.920101 24703 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } }
I20260810 04:13:57.920331 24703 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7d209f277240e98eed19bd3d946520, State: Initialized, Role: FOLLOWER
I20260810 04:13:57.920496 24703 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } }
I20260810 04:13:57.920590 24703 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:13:57.920647 24703 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:13:57.920701 24703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:13:57.921682 24703 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } }
I20260810 04:13:57.921833 24703 leader_election.cc:302] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb7d209f277240e98eed19bd3d946520; no voters:
I20260810 04:13:57.922045 24703 leader_election.cc:288] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 04:13:57.922080 24707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:13:57.922185 24707 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [term 2 LEADER]: Becoming Leader. State: Replica: eb7d209f277240e98eed19bd3d946520, State: Running, Role: LEADER
I20260810 04:13:57.922315 24703 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:13:57.922343 24707 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } }
I20260810 04:13:57.922714 24709 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb7d209f277240e98eed19bd3d946520. Latest consensus state: current_term: 2 leader_uuid: "eb7d209f277240e98eed19bd3d946520" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } } }
I20260810 04:13:57.922811 24709 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: This master's current role is: LEADER
I20260810 04:13:57.922725 24708 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "eb7d209f277240e98eed19bd3d946520" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb7d209f277240e98eed19bd3d946520" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43853 } } }
I20260810 04:13:57.922855 24708 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520 [sys.catalog]: This master's current role is: LEADER
I20260810 04:13:57.923316 24712 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:13:57.923930 24712 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:13:57.924062 24712 catalog_manager.cc:1259] Loaded cluster ID: a3d6d735e67d424abd42f1654b1622af
I20260810 04:13:57.924103 24712 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:13:57.924316 24703 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 04:13:57.927572 24712 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:13:57.928102 24712 catalog_manager.cc:5879] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Loaded TSK: 0
I20260810 04:13:57.928380 24712 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:13:58.010529 24705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:58.010865 24705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:58.010957 24705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:58.012516 24705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:58.012620 24705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:58.012717 24705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:13:58.014835 24705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.249.148:41187/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:33869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=41731
--tserver_master_addrs=127.10.249.190:43853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:58.015239 24705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:58.015504 24705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:58.022996 24744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:58.023303 24743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:58.024770 24746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:58.026912 24705 server_base.cc:1034] running on GCE node
I20260810 04:13:58.027127 24705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:58.027386 24705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:58.028486 24705 hybrid_clock.cc:648] HybridClock initialized: now 1786335238028468 us; error 41 us; skew 500 ppm
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:58.031394 24705 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:13:58.031842 24705 webserver.cc:460] Webserver started at http://127.10.249.129:41731/ using document root <none> and password file <none>
I20260810 04:13:58.032096 24705 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:58.032168 24705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:58.058130 24705 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.000s
I20260810 04:13:58.062230 24754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.062393 24705 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260810 04:13:58.062474 24705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "d3da4adeeb4f48edb134501205c2ed7d"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "d940bb1d605ed85cb83d189e95a120b2"
server_key_iv: "9cc8210e42e1df5f5f9bd0387520e815"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:58.063014 24705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:58.083678 24705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:58.085781 24705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:58.085951 24705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:58.086199 24705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:58.086552 24705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:58.086593 24705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.086629 24705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:58.086648 24705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.093393 24705 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:33869
I20260810 04:13:58.093463 24874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:33869 every 8 connection(s)
I20260810 04:13:58.094297 24705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:13:58.094982 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 24705
I20260810 04:13:58.095333 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:41187/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:34387
--local_ip_for_outbound_sockets=127.10.249.130
--tserver_master_addrs=127.10.249.190:43853
--webserver_port=42305
--webserver_interface=127.10.249.130
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.249.148:41187/kms with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:58.107191 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:58.096993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:38257 (local address 127.10.249.190:43853)
0810 04:13:58.097734 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:58.097746 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:58.097821 (+ 75us) server_negotiation.cc:407] Connection header received
0810 04:13:58.097981 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:58.097990 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:58.098049 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:58.098221 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:58.098880 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.099725 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.100919 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.101427 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.101554 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:58.103558 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:58.103563 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:58.103563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:58.103575 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:58.105391 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:58.105982 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:58.105985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:58.105985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:58.106075 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:58.106372 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:58.106373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:58.106373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:58.106566 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:58.106650 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:58.106930 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 04:13:58.107023 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":110,"threads_started":1}
I20260810 04:13:58.107206 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:58.095038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43853 (local address 127.10.249.129:38257)
0810 04:13:58.095243 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:58.095291 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:58.096012 (+ 721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:58.098277 (+ 2265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:58.098282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:58.098488 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:58.098766 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:58.098772 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.099874 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.099876 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:58.100818 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:58.100821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.101546 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.101547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:58.101663 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:58.102161 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:58.102170 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:58.103438 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:58.105496 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:58.105502 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:58.105504 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:58.105891 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:58.106171 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:58.106172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:58.106172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:58.106292 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:58.106646 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:58.106652 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:58.106782 (+ 130us) client_negotiation.cc:769] Sending connection context
0810 04:13:58.106872 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 04:13:58.107012 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260810 04:13:58.107966 24875 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43853
I20260810 04:13:58.108073 24875 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.108243 24875 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
W20260810 04:13:58.109059 24875 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:43853 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 04:13:58.109115 24875 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.109162 24875 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:58.110298 24875 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.110376 24875 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
W20260810 04:13:58.110654 24875 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:13:58.210283 24878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:58.210546 24878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:58.210577 24878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:58.212023 24878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:58.212106 24878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:58.212194 24878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:13:58.214319 24878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.249.148:41187/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:34387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=42305
--tserver_master_addrs=127.10.249.190:43853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:58.214713 24878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:58.214967 24878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:58.220729 24886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:58.220749 24885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:58.220880 24888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:58.221123 24878 server_base.cc:1034] running on GCE node
I20260810 04:13:58.221304 24878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:58.221544 24878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:58.222777 24878 hybrid_clock.cc:648] HybridClock initialized: now 1786335238222757 us; error 36 us; skew 500 ppm
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:58.226451 24878 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:13:58.226960 24878 webserver.cc:460] Webserver started at http://127.10.249.130:42305/ using document root <none> and password file <none>
I20260810 04:13:58.227186 24878 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:58.227303 24878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:58.248497 24878 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260810 04:13:58.249630 24896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.249825 24878 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:13:58.249912 24878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "c2d7ab705df34a3aa9ada7127b12f311"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "ae096cde069852b3bbf15a0bb4f69c5f"
server_key_iv: "b77cc4f77f1ef86e3b713e419ba45f4c"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:58.250348 24878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:58.276327 24878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:58.278251 24878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:58.278398 24878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:58.278688 24878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:58.279047 24878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:58.279096 24878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.279132 24878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:58.279158 24878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.285851 24878 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:34387
I20260810 04:13:58.285948 25016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:34387 every 8 connection(s)
I20260810 04:13:58.286298 24878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:13:58.288691 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 24878
I20260810 04:13:58.288983 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.249.148:41187/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:46137
--local_ip_for_outbound_sockets=127.10.249.131
--tserver_master_addrs=127.10.249.190:43853
--webserver_port=33429
--webserver_interface=127.10.249.131
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.249.148:41187/kms with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:58.296017 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:58.287393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:42023 (local address 127.10.249.190:43853)
0810 04:13:58.287437 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:58.287439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:58.287453 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:13:58.288085 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:58.288087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:58.288102 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:58.288149 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:58.288796 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.289410 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.290758 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.291026 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.291098 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:58.293445 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:58.293446 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:58.293447 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:58.293455 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:58.294759 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:58.295194 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:58.295194 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:58.295195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:58.295238 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:58.295481 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:58.295481 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:58.295481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:58.295565 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:58.295607 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:58.295897 (+ 290us) server_negotiation.cc:299] Negotiation successful
0810 04:13:58.295960 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:13:58.296244 25019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:58.287162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43853 (local address 127.10.249.130:42023)
0810 04:13:58.287340 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:58.287386 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:58.287967 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:58.288224 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:58.288228 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:58.288425 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:58.288692 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:58.288699 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.289533 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.289534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:58.290642 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:58.290645 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.291121 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.291122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:58.291244 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:58.291731 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:58.291741 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:58.293340 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:58.294841 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:58.294848 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:58.294850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:58.295119 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:58.295298 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:58.295299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:58.295299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:58.295421 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:58.295625 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:58.295632 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:58.295773 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 04:13:58.295883 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 04:13:58.296022 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":82,"threads_started":1}
I20260810 04:13:58.296697 25017 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43853
I20260810 04:13:58.296797 25017 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.296953 25017 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
W20260810 04:13:58.297559 25017 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:43853 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 04:13:58.297632 25017 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.297699 25017 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:58.298061 25017 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.298130 25017 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
W20260810 04:13:58.298513 25017 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:13:58.396957 25020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:13:58.397271 25020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:13:58.397343 25020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:13:58.398969 25020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:13:58.399086 25020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:13:58.399163 25020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:13:58.401283 25020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.249.148:41187/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:46137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=33429
--tserver_master_addrs=127.10.249.190:43853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:13:58.401726 25020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:13:58.402041 25020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:13:58.408267 25026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:58.408293 25029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:13:58.408586 25027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:13:58.409389 25020 server_base.cc:1034] running on GCE node
I20260810 04:13:58.409644 25020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:13:58.409981 25020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:13:58.411160 25020 hybrid_clock.cc:648] HybridClock initialized: now 1786335238411145 us; error 26 us; skew 500 ppm
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:58.414748 25020 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:13:58.415241 25020 webserver.cc:460] Webserver started at http://127.10.249.131:33429/ using document root <none> and password file <none>
I20260810 04:13:58.415493 25020 fs_manager.cc:359] Metadata directory not provided
I20260810 04:13:58.415585 25020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:58.429603 25020 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:13:58.430567 25037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.430737 25020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:13:58.430823 25020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "31474d77cff141cb847cf14b75c1a4af"
format_stamp: "Formatted at 2026-08-10 04:13:57 on dist-test-slave-0kls"
server_key: "9bdaeb2d93eeec460248aa57030bbec8"
server_key_iv: "0825bdb2a4a52b537de9da8a19d680ef"
server_key_version: "kuduclusterkey@0"
I20260810 04:13:58.431142 25020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:13:58.440882 25020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:13:58.442890 25020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:13:58.443027 25020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:13:58.443236 25020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:13:58.443528 25020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:13:58.443567 25020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.443593 25020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:13:58.443610 25020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:13:58.450562 25020 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:46137
I20260810 04:13:58.450908 25157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:46137 every 8 connection(s)
I20260810 04:13:58.450977 25020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:13:58.460727 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 25020
I20260810 04:13:58.461272 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:58.451821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:38259 (local address 127.10.249.190:43853)
0810 04:13:58.452069 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:58.452072 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:58.452119 (+ 47us) server_negotiation.cc:407] Connection header received
0810 04:13:58.452774 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:58.452776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:58.452790 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:58.452820 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:58.453603 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.454314 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.455602 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.455840 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.455885 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:58.458256 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:58.458257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:58.458258 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:58.458266 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:58.459690 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:58.460131 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:58.460132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:58.460133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:58.460195 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:58.460453 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:58.460454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:58.460455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:58.460616 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:58.460685 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:58.461074 (+ 389us) server_negotiation.cc:299] Negotiation successful
0810 04:13:58.461166 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217}
I20260810 04:13:58.461647 25160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:58.451820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43853 (local address 127.10.249.131:38259)
0810 04:13:58.451982 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:58.452050 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:58.452629 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:58.452997 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:58.453001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:58.453223 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:13:58.453477 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:58.453482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.454414 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.454415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:58.455497 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:58.455501 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.455986 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.455987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:58.456105 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:58.456611 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:13:58.456620 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:13:58.458155 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:13:58.459806 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:58.459812 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:58.459815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:58.460035 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:58.460263 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:13:58.460264 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:13:58.460264 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:13:58.460379 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:13:58.460717 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:13:58.460724 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:13:58.460896 (+ 172us) client_negotiation.cc:769] Sending connection context
0810 04:13:58.461045 (+ 149us) client_negotiation.cc:240] Negotiation successful
0810 04:13:58.461407 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260810 04:13:58.462137 25158 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43853
I20260810 04:13:58.462241 25158 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.462431 25158 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
W20260810 04:13:58.463155 25158 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:43853 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 04:13:58.463240 25158 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.463318 25158 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:58.463953 25158 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:58.464038 25158 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
W20260810 04:13:58.464362 25158 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 04:13:58.472199 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:58.461145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58356 (local address 127.10.249.190:43853)
0810 04:13:58.461347 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:58.461349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:58.463600 (+ 2251us) server_negotiation.cc:407] Connection header received
0810 04:13:58.463657 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:58.463658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:58.463666 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:58.463711 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:58.466179 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.466793 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.467938 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:58.468183 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:58.468245 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:58.469869 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:58.469870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:58.469871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:58.469878 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:58.471134 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:58.471502 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:58.471503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:58.471504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:58.471559 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:58.471753 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:58.471754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:58.471754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:58.471847 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:58.472002 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:58.472034 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 04:13:58.472099 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":73,"threads_started":1}
Aug 10 04:13:58 dist-test-slave-0kls krb5kdc[23596](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:13:59.110859 24875 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:59.111019 24875 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:59.111515 24664 ts_manager.cc:194] Registered new tserver with Master: d3da4adeeb4f48edb134501205c2ed7d (127.10.249.129:33869)
I20260810 04:13:59.112504 24664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:38257
Aug 10 04:13:59 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
I20260810 04:13:59.298666 25017 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:59.298797 25017 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:59.299093 24664 ts_manager.cc:194] Registered new tserver with Master: c2d7ab705df34a3aa9ada7127b12f311 (127.10.249.130:34387)
I20260810 04:13:59.299587 24664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:42023
I20260810 04:13:59.464543 25158 heartbeater.cc:464] Registering TS with master...
I20260810 04:13:59.464713 25158 heartbeater.cc:511] Master 127.10.249.190:43853 requested a full tablet report, sending...
I20260810 04:13:59.464977 24664 ts_manager.cc:194] Registered new tserver with Master: 31474d77cff141cb847cf14b75c1a4af (127.10.249.131:46137)
I20260810 04:13:59.465481 24664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:38259
I20260810 04:13:59.473963 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:13:59.484851 25181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.474980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58370 (local address 127.10.249.190:43853)
0810 04:13:59.475424 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:59.475426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:59.475433 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:13:59.475453 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:59.475454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:59.475466 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:59.475661 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:13:59.477865 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.478588 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.479597 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.479918 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.479983 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.481506 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:13:59.481507 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:13:59.481508 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:13:59.481525 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:13:59.483284 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:59.483721 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:59.483722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:59.483722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:59.483786 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:13:59.484016 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:13:59.484017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:13:59.484018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:13:59.484146 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:13:59.484650 (+ 504us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:59.484691 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 04:13:59.484765 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":65,"threads_started":1}
I20260810 04:13:59.487118 24664 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:13:59.489341 24664 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:13:59.502265 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.494976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:34387 (local address 127.0.0.1:45838)
0810 04:13:59.498016 (+ 3040us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:59.498048 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:59.498135 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:59.498510 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:59.498513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:59.498515 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:59.498584 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.498586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.499737 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.499738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.501003 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.501005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.502009 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.502009 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.502073 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.502086 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 04:13:59.502141 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 04:13:59.502191 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3010,"thread_start_us":88,"threads_started":1}
I20260810 04:13:59.502523 25187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.495234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45838 (local address 127.10.249.130:34387)
0810 04:13:59.498269 (+ 3035us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:59.498274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:59.498284 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:13:59.498317 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:59.498319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:59.498336 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:59.498406 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:59.498683 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.499640 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.501093 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.501871 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.501931 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.501979 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:59.502377 (+ 398us) server_negotiation.cc:299] Negotiation successful
0810 04:13:59.502440 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2999,"thread_start_us":57,"threads_started":1}
I20260810 04:13:59.503244 24948 tablet_service.cc:1467] Processing CreateTablet for tablet 44d912af53d044a3b99c219510586939 (DEFAULT_TABLE table=test-table [id=969eac7a9a694e5993e93dcb06015280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:13:59.503618 24948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d912af53d044a3b99c219510586939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:13:59.506088 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.495598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:46137 (local address 127.0.0.1:57706)
0810 04:13:59.498625 (+ 3027us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:59.498633 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:59.498676 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:59.499270 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:59.499271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:59.499272 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:59.499295 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.499296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.500519 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.500520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.504622 (+ 4102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.504624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.505852 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.505853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.505919 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.505924 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:13:59.505984 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:13:59.506018 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3012,"thread_start_us":56,"threads_started":1}
I20260810 04:13:59.506382 25191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.495807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57706 (local address 127.10.249.131:46137)
0810 04:13:59.498577 (+ 2770us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:59.498582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:59.498726 (+ 144us) server_negotiation.cc:407] Connection header received
0810 04:13:59.498760 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:59.498762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:59.498777 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:59.498839 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:59.499360 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.500425 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.504704 (+ 4279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.505563 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.505663 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.505739 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:59.506247 (+ 508us) server_negotiation.cc:299] Negotiation successful
0810 04:13:59.506297 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2735,"thread_start_us":50,"threads_started":1}
I20260810 04:13:59.506958 25088 tablet_service.cc:1467] Processing CreateTablet for tablet 44d912af53d044a3b99c219510586939 (DEFAULT_TABLE table=test-table [id=969eac7a9a694e5993e93dcb06015280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:13:59.507320 25088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d912af53d044a3b99c219510586939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:13:59.509281 25192 tablet_bootstrap.cc:492] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311: Bootstrap starting.
I20260810 04:13:59.510943 25192 tablet_bootstrap.cc:654] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311: Neither blocks nor log segments found. Creating new log.
I20260810 04:13:59.511711 25192 log.cc:824] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:59.512667 25192 tablet_bootstrap.cc:492] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311: No bootstrap required, opened a new log
I20260810 04:13:59.512727 25196 tablet_bootstrap.cc:492] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Bootstrap starting.
I20260810 04:13:59.512871 25192 ts_tablet_manager.cc:1397] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260810 04:13:59.514173 25196 tablet_bootstrap.cc:654] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Neither blocks nor log segments found. Creating new log.
I20260810 04:13:59.514622 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.495438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:33869 (local address 127.0.0.1:46328)
0810 04:13:59.498422 (+ 2984us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:59.498431 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:59.498473 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:59.499170 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:59.499171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:59.499173 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:59.499209 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.499210 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.502142 (+ 2932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.502154 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.503609 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.503613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.514330 (+ 10717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.514331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.514416 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.514427 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 04:13:59.514477 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:13:59.514516 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2967,"thread_start_us":78,"threads_started":1}
I20260810 04:13:59.514978 25196 log.cc:824] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:59.515518 25189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.495535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46328 (local address 127.10.249.129:33869)
0810 04:13:59.498960 (+ 3425us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:59.498964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:59.498973 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:13:59.499001 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:59.499002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:59.499015 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:59.499079 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:59.501162 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.502069 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.512863 (+ 10794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.514052 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.514198 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.514265 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:59.515317 (+ 1052us) server_negotiation.cc:299] Negotiation successful
0810 04:13:59.515377 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3391,"thread_start_us":63,"threads_started":1}
I20260810 04:13:59.516278 24797 tablet_service.cc:1467] Processing CreateTablet for tablet 44d912af53d044a3b99c219510586939 (DEFAULT_TABLE table=test-table [id=969eac7a9a694e5993e93dcb06015280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:13:59.516652 24797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d912af53d044a3b99c219510586939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:13:59.516993 25196 tablet_bootstrap.cc:492] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: No bootstrap required, opened a new log
I20260810 04:13:59.517047 25196 ts_tablet_manager.cc:1397] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260810 04:13:59.521431 25196 raft_consensus.cc:348] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.521725 25196 raft_consensus.cc:374] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:13:59.521770 25196 raft_consensus.cc:729] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31474d77cff141cb847cf14b75c1a4af, State: Initialized, Role: FOLLOWER
I20260810 04:13:59.521986 25196 consensus_queue.cc:260] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.522418 25196 ts_tablet_manager.cc:1428] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 04:13:59.522534 25158 heartbeater.cc:503] Master 127.10.249.190:43853 was elected leader, sending a full tablet report...
I20260810 04:13:59.524533 25192 raft_consensus.cc:348] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.524729 25192 raft_consensus.cc:374] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:13:59.524791 25192 raft_consensus.cc:729] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d7ab705df34a3aa9ada7127b12f311, State: Initialized, Role: FOLLOWER
I20260810 04:13:59.524930 25192 consensus_queue.cc:260] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.525341 25192 ts_tablet_manager.cc:1428] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311: Time spent starting tablet: real 0.012s user 0.004s sys 0.001s
I20260810 04:13:59.525484 25017 heartbeater.cc:503] Master 127.10.249.190:43853 was elected leader, sending a full tablet report...
I20260810 04:13:59.526412 25198 tablet_bootstrap.cc:492] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d: Bootstrap starting.
I20260810 04:13:59.527567 25198 tablet_bootstrap.cc:654] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d: Neither blocks nor log segments found. Creating new log.
I20260810 04:13:59.528430 25198 log.cc:824] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:13:59.529712 25198 tablet_bootstrap.cc:492] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d: No bootstrap required, opened a new log
I20260810 04:13:59.533272 25198 ts_tablet_manager.cc:1397] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260810 04:13:59.538139 25198 raft_consensus.cc:348] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.538376 25198 raft_consensus.cc:374] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:13:59.538430 25198 raft_consensus.cc:729] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3da4adeeb4f48edb134501205c2ed7d, State: Initialized, Role: FOLLOWER
I20260810 04:13:59.538574 25198 consensus_queue.cc:260] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.538888 25198 ts_tablet_manager.cc:1428] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260810 04:13:59.539003 24875 heartbeater.cc:503] Master 127.10.249.190:43853 was elected leader, sending a full tablet report...
Aug 10 04:13:59 dist-test-slave-0kls krb5kdc[23596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335238, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for HTTP/127.10.249.148@KRBTEST.COM
W20260810 04:13:59.543097 25018 tablet.cc:2369] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:13:59.595743 24876 tablet.cc:2369] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:13:59.664559 25199 raft_consensus.cc:482] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:13:59.664734 25199 raft_consensus.cc:504] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.665325 25199 leader_election.cc:288] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3da4adeeb4f48edb134501205c2ed7d (127.10.249.129:33869), c2d7ab705df34a3aa9ada7127b12f311 (127.10.249.130:34387)
I20260810 04:13:59.680310 25189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.666050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:38247 (local address 127.10.249.129:33869)
0810 04:13:59.666100 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:59.666102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:59.671829 (+ 5727us) server_negotiation.cc:407] Connection header received
0810 04:13:59.671933 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:59.671934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:59.671943 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:59.671970 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:59.672632 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.673430 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.678263 (+ 4833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.678766 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.678813 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.678822 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:59.680188 (+ 1366us) server_negotiation.cc:299] Negotiation successful
0810 04:13:59.680236 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:13:59.680873 25205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.665572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:33869 (local address 127.10.249.131:38247)
0810 04:13:59.671757 (+ 6185us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:59.671768 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:59.671859 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:59.672116 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:59.672116 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:59.672118 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:59.672198 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.672200 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.673546 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.673547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.678173 (+ 4626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.678175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.678894 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.678895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.678957 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.678961 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:13:59.680635 (+ 1674us) client_negotiation.cc:240] Negotiation successful
0810 04:13:59.680682 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6166,"thread_start_us":730,"threads_started":1}
I20260810 04:13:59.681699 25187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.665928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:58159 (local address 127.10.249.130:34387)
0810 04:13:59.665985 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:59.665988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:59.668828 (+ 2840us) server_negotiation.cc:407] Connection header received
0810 04:13:59.672281 (+ 3453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:59.672283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:59.672294 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:59.672323 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:13:59.674074 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.674746 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.679055 (+ 4309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.679764 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.679818 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.679826 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:59.681593 (+ 1767us) server_negotiation.cc:299] Negotiation successful
0810 04:13:59.681638 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:13:59.682571 24827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d912af53d044a3b99c219510586939" candidate_uuid: "31474d77cff141cb847cf14b75c1a4af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3da4adeeb4f48edb134501205c2ed7d" is_pre_election: true
I20260810 04:13:59.682767 24827 raft_consensus.cc:2454] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31474d77cff141cb847cf14b75c1a4af in term 0.
I20260810 04:13:59.683136 25041 leader_election.cc:302] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31474d77cff141cb847cf14b75c1a4af, d3da4adeeb4f48edb134501205c2ed7d; no voters:
I20260810 04:13:59.683275 25199 raft_consensus.cc:2781] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:13:59.683322 25199 raft_consensus.cc:482] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:13:59.683346 25199 raft_consensus.cc:3037] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:13:59.684266 25199 raft_consensus.cc:504] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.684404 25199 leader_election.cc:288] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [CANDIDATE]: Term 1 election: Requested vote from peers d3da4adeeb4f48edb134501205c2ed7d (127.10.249.129:33869), c2d7ab705df34a3aa9ada7127b12f311 (127.10.249.130:34387)
I20260810 04:13:59.684684 24827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d912af53d044a3b99c219510586939" candidate_uuid: "31474d77cff141cb847cf14b75c1a4af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3da4adeeb4f48edb134501205c2ed7d"
I20260810 04:13:59.684758 24827 raft_consensus.cc:3037] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:13:59.685891 24827 raft_consensus.cc:2454] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31474d77cff141cb847cf14b75c1a4af in term 1.
I20260810 04:13:59.686189 25041 leader_election.cc:302] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31474d77cff141cb847cf14b75c1a4af, d3da4adeeb4f48edb134501205c2ed7d; no voters:
I20260810 04:13:59.686317 25199 raft_consensus.cc:2781] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:13:59.686467 25199 raft_consensus.cc:686] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 1 LEADER]: Becoming Leader. State: Replica: 31474d77cff141cb847cf14b75c1a4af, State: Running, Role: LEADER
I20260810 04:13:59.686555 25199 consensus_queue.cc:237] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } }
I20260810 04:13:59.687474 24663 catalog_manager.cc:5495] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af reported cstate change: term changed from 0 to 1, leader changed from <none> to 31474d77cff141cb847cf14b75c1a4af (127.10.249.131). New cstate: current_term: 1 leader_uuid: "31474d77cff141cb847cf14b75c1a4af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31474d77cff141cb847cf14b75c1a4af" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 46137 } health_report { overall_health: HEALTHY } } }
I20260810 04:13:59.682245 25204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.665531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:34387 (local address 127.10.249.131:58159)
0810 04:13:59.668752 (+ 3221us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:59.668765 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:13:59.672009 (+ 3244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:13:59.672379 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:13:59.672379 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:13:59.672381 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:13:59.672538 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.672541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.674851 (+ 2310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.674852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.677328 (+ 2476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:13:59.677331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.679887 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.679888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:13:59.680092 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.680096 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:13:59.682103 (+ 2007us) client_negotiation.cc:240] Negotiation successful
0810 04:13:59.682169 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3195,"thread_start_us":638,"threads_started":1}
I20260810 04:13:59.688987 24957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d912af53d044a3b99c219510586939" candidate_uuid: "31474d77cff141cb847cf14b75c1a4af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d7ab705df34a3aa9ada7127b12f311" is_pre_election: true
I20260810 04:13:59.689155 24957 raft_consensus.cc:2454] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31474d77cff141cb847cf14b75c1a4af in term 0.
I20260810 04:13:59.689096 24970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d912af53d044a3b99c219510586939" candidate_uuid: "31474d77cff141cb847cf14b75c1a4af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d7ab705df34a3aa9ada7127b12f311"
I20260810 04:13:59.689429 24970 raft_consensus.cc:3037] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:13:59.690306 24970 raft_consensus.cc:2454] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31474d77cff141cb847cf14b75c1a4af in term 1.
W20260810 04:13:59.702412 25159 tablet.cc:2369] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:13:59.742067 25191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.738447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57722 (local address 127.10.249.131:46137)
0810 04:13:59.738510 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:13:59.738513 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:13:59.738526 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:13:59.738582 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:13:59.738583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:13:59.738608 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:13:59.738717 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:13:59.738876 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.739584 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.740817 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:13:59.741176 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:13:59.741246 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:13:59.741470 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:13:59.741614 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:13:59.741695 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:13:59.741947 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 04:13:59.741969 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:13:59.749683 24827 raft_consensus.cc:1261] T 44d912af53d044a3b99c219510586939 P d3da4adeeb4f48edb134501205c2ed7d [term 1 FOLLOWER]: Refusing update from remote peer 31474d77cff141cb847cf14b75c1a4af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:13:59.749682 24970 raft_consensus.cc:1261] T 44d912af53d044a3b99c219510586939 P c2d7ab705df34a3aa9ada7127b12f311 [term 1 FOLLOWER]: Refusing update from remote peer 31474d77cff141cb847cf14b75c1a4af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:13:59.750088 25206 consensus_queue.cc:1035] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d7ab705df34a3aa9ada7127b12f311" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 34387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:13:59.750204 25199 consensus_queue.cc:1035] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3da4adeeb4f48edb134501205c2ed7d" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:13:59.754129 25209 mvcc.cc:205] Tried to move back new op lower bound from 7316829142010679296 to 7316829141756563456. Current Snapshot: MvccSnapshot[applied={T|T < 7316829142010679296}]
I20260810 04:13:59.754555 25211 mvcc.cc:205] Tried to move back new op lower bound from 7316829142010679296 to 7316829141756563456. Current Snapshot: MvccSnapshot[applied={T|T < 7316829142010679296}]
I20260810 04:13:59.758230 25210 mvcc.cc:205] Tried to move back new op lower bound from 7316829142010679296 to 7316829141756563456. Current Snapshot: MvccSnapshot[applied={T|T < 7316829142010679296}]
I20260810 04:13:59.758229 24663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:13:59.758327 24663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:13:59.759048 24663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb7d209f277240e98eed19bd3d946520: Sending DeleteTablet for 3 replicas of tablet 44d912af53d044a3b99c219510586939
I20260810 04:13:59.759425 24797 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d912af53d044a3b99c219510586939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:13:59 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:46328
I20260810 04:13:59.759496 25088 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d912af53d044a3b99c219510586939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:13:59 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:57706
I20260810 04:13:59.759882 24948 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d912af53d044a3b99c219510586939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:13:59 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:45838
I20260810 04:13:59.760166 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 24705
I20260810 04:13:59.769902 25219 tablet_replica.cc:330] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: stopping tablet replica
I20260810 04:13:59.770087 25219 raft_consensus.cc:2229] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 1 LEADER]: Raft consensus shutting down.
W20260810 04:13:59.770166 24650 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:33869 (error 108)
I20260810 04:13:59.770332 25219 raft_consensus.cc:2258] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:13:59.770735 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 24878
I20260810 04:13:59.770926 25219 ts_tablet_manager.cc:1905] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:13:59.773694 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.773533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:33869 (local address 127.0.0.1:46330)
0810 04:13:59.773610 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:59.773655 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:33869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 04:13:59.773934 24650 catalog_manager.cc:4584] TS d3da4adeeb4f48edb134501205c2ed7d (127.10.249.129:33869): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 44d912af53d044a3b99c219510586939: Network error: Client connection negotiation failed: client connection to 127.10.249.129:33869: connect: Connection refused (error 111)
I20260810 04:13:59.774150 25219 ts_tablet_manager.cc:1918] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:13:59.774246 25219 log.cc:1196] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/44d912af53d044a3b99c219510586939
I20260810 04:13:59.774559 25219 ts_tablet_manager.cc:1939] T 44d912af53d044a3b99c219510586939 P 31474d77cff141cb847cf14b75c1a4af: Deleting consensus metadata
I20260810 04:13:59.775024 24650 catalog_manager.cc:4841] TS 31474d77cff141cb847cf14b75c1a4af (127.10.249.131:46137): tablet 44d912af53d044a3b99c219510586939 (table test-table [id=969eac7a9a694e5993e93dcb06015280]) successfully deleted
I20260810 04:13:59.778839 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 25020
I20260810 04:13:59.783253 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:13:59.783106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:34387 (local address 127.0.0.1:45840)
0810 04:13:59.783180 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0810 04:13:59.783218 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.130:34387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 04:13:59.787619 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 24631
I20260810 04:13:59.794873 11238 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 04:14:00.140697 11238 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 04:14:00.140791 11238 mini_ranger.cc:66] Stopping Ranger...
I20260810 04:14:00.486366 11238 mini_ranger.cc:68] Stopped Ranger
2026-08-10 04:14:00.486 UTC [23628] LOG: received smart shutdown request
2026-08-10 04:14:00.490 UTC [23628] LOG: background worker "logical replication launcher" (PID 23639) exited with exit code 1
2026-08-10 04:14:00.491 UTC [23633] LOG: shutting down
2026-08-10 04:14:00.642 UTC [23628] LOG: database system is shut down
2026-08-10T04:14:00Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (44444 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:14:00 dist-test-slave-0kls krb5kdc[25231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:14:00 dist-test-slave-0kls krb5kdc[25231](info): set up 2 sockets
Aug 10 04:14:00 dist-test-slave-0kls krb5kdc[25231](info): commencing operation
krb5kdc: starting...
W20260810 04:14:01.748970 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.980s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:14:01 dist-test-slave-0kls krb5kdc[25231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:14:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:14:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:14:01.865079 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:32911
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:34837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:32911,127.10.249.189:37253,127.10.249.188:45727
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:01.945032 25244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:01.945199 25244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:01.945235 25244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:01.946230 25244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:01.946261 25244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:01.946274 25244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:01.946285 25244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:01.946296 25244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:01.947564 25244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:34837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:32911,127.10.249.189:37253,127.10.249.188:45727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:32911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:01.947723 25244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:01.947862 25244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:01.952257 25253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:01.952297 25252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:01.952467 25244 server_base.cc:1034] running on GCE node
W20260810 04:14:01.952296 25257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:01.952818 25244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:01.953127 25244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:01.954293 25244 hybrid_clock.cc:648] HybridClock initialized: now 1786335241954278 us; error 27 us; skew 500 ppm
Aug 10 04:14:01 dist-test-slave-0kls krb5kdc[25231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335241, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:01.956488 25244 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:14:01.956875 25244 webserver.cc:460] Webserver started at http://127.10.249.190:46227/ using document root <none> and password file <none>
I20260810 04:14:01.957087 25244 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:01.957154 25244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:01.957288 25244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:01.958214 25244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "785d065533d34f129b083f0c70bc6720"
format_stamp: "Formatted at 2026-08-10 04:14:01 on dist-test-slave-0kls"
server_key: "54b28fa70d20a188bb24b7b0a61c6fca"
server_key_iv: "48fd951bae69e8aaca628348828bb5ca"
server_key_version: "encryptionkey@0"
I20260810 04:14:01.958526 25244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "785d065533d34f129b083f0c70bc6720"
format_stamp: "Formatted at 2026-08-10 04:14:01 on dist-test-slave-0kls"
server_key: "54b28fa70d20a188bb24b7b0a61c6fca"
server_key_iv: "48fd951bae69e8aaca628348828bb5ca"
server_key_version: "encryptionkey@0"
I20260810 04:14:01.959669 25244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:14:01.960408 25264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:01.960590 25244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:01.960693 25244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "785d065533d34f129b083f0c70bc6720"
format_stamp: "Formatted at 2026-08-10 04:14:01 on dist-test-slave-0kls"
server_key: "54b28fa70d20a188bb24b7b0a61c6fca"
server_key_iv: "48fd951bae69e8aaca628348828bb5ca"
server_key_version: "encryptionkey@0"
I20260810 04:14:01.960770 25244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:01.988216 25244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:01.990202 25244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:01.990340 25244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:01.993849 25244 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:32911
I20260810 04:14:01.993897 25319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:32911 every 8 connection(s)
I20260810 04:14:01.994241 25244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:14:01.995028 25320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:01.996411 25320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:14:02.000382 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 25244
I20260810 04:14:02.000500 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:14:02.000739 11238 external_mini_cluster.cc:1428] Setting key 7e98a58d270a8ba2910e9d9a8c3645e0
Aug 10 04:14:01 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335241, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:02.006862 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:01.997017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:32911 (local address 127.0.0.1:38556)
0810 04:14:01.997178 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:01.997215 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:01.997672 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:01.997915 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:01.997917 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:01.998120 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:01.998269 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:01.998273 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:01.999131 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:01.999132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:01.999729 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:01.999731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.000220 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.000222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.000308 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.000795 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.000806 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.002596 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.005130 (+ 2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.005136 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.005138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.005432 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.005696 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.005697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.005697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.005817 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.006238 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.006243 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.006347 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.006437 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.006590 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
I20260810 04:14:02.006867 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:01.997059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38556 (local address 127.10.249.190:32911)
0810 04:14:01.997224 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:01.997228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:01.997286 (+ 58us) server_negotiation.cc:407] Connection header received
0810 04:14:01.997804 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:01.997806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:01.997822 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:01.997909 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:01.998351 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:01.999037 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:01.999839 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.000127 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.000201 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.002721 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.002731 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.002731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.002740 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.005044 (+ 2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.005530 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.005533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.005533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.005643 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.005866 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.005867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.005868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.006182 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.006271 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.006484 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.006686 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":115,"thread_start_us":91,"threads_started":1}
I20260810 04:14:02.009218 25320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:14:02.009539 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.009430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36270)
0810 04:14:02.009472 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.009512 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 04:14:02.009686 25265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.10.249.189@KRBTEST.COM; defaulting to no policy
I20260810 04:14:02.010277 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.010143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36282)
0810 04:14:02.010239 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.010260 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260810 04:14:02.010382 25320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:37253: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab.
Entry for principal kudu/127.10.249.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab.
I20260810 04:14:02.025624 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.189:37253
--webserver_interface=127.10.249.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab
--principal=kudu/127.10.249.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:34837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:32911,127.10.249.189:37253,127.10.249.188:45727
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:02.059597 25320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } attempt: 1
I20260810 04:14:02.060071 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.059938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36288)
0810 04:14:02.060005 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.060042 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 04:14:02.060421 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.060326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36292)
0810 04:14:02.060369 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.060396 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 04:14:02.060516 25320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:37253: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
W20260810 04:14:02.105731 25328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:02.105988 25328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:02.106026 25328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:02.107201 25328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:02.107270 25328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:02.107295 25328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:02.107326 25328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:02.107372 25328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:02.108825 25328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:34837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:32911,127.10.249.189:37253,127.10.249.188:45727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab
--principal=kudu/127.10.249.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.189:37253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.249.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:02.109102 25328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:02.109319 25328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:02.114034 25334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:02.114101 25337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:02.114035 25335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:02.114250 25328 server_base.cc:1034] running on GCE node
I20260810 04:14:02.114485 25328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:02.114784 25328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:02.115950 25328 hybrid_clock.cc:648] HybridClock initialized: now 1786335242115933 us; error 44 us; skew 500 ppm
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335242, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:02.118327 25328 init.cc:377] Logged in from keytab as kudu/127.10.249.189@KRBTEST.COM (short username kudu)
I20260810 04:14:02.118821 25328 webserver.cc:460] Webserver started at http://127.10.249.189:37533/ using document root <none> and password file <none>
I20260810 04:14:02.119055 25328 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:02.119120 25328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:02.119285 25328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:02.120344 25328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/data/instance:
uuid: "8e69771749894cfba5f75cafb54f6df0"
format_stamp: "Formatted at 2026-08-10 04:14:02 on dist-test-slave-0kls"
server_key: "e4ec2efa9f0a13bb9158cac30fb6734c"
server_key_iv: "dd79a9c80cb0ec3cc63f3a617201e497"
server_key_version: "encryptionkey@0"
I20260810 04:14:02.120728 25328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/wal/instance:
uuid: "8e69771749894cfba5f75cafb54f6df0"
format_stamp: "Formatted at 2026-08-10 04:14:02 on dist-test-slave-0kls"
server_key: "e4ec2efa9f0a13bb9158cac30fb6734c"
server_key_iv: "dd79a9c80cb0ec3cc63f3a617201e497"
server_key_version: "encryptionkey@0"
I20260810 04:14:02.122067 25328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:14:02.122790 25345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:02.122967 25328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:02.123075 25328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/wal
uuid: "8e69771749894cfba5f75cafb54f6df0"
format_stamp: "Formatted at 2026-08-10 04:14:02 on dist-test-slave-0kls"
server_key: "e4ec2efa9f0a13bb9158cac30fb6734c"
server_key_iv: "dd79a9c80cb0ec3cc63f3a617201e497"
server_key_version: "encryptionkey@0"
I20260810 04:14:02.123147 25328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:02.128650 25320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } attempt: 2
I20260810 04:14:02.129043 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.128923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36306)
0810 04:14:02.128979 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.129016 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 04:14:02.129376 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.129276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36316)
0810 04:14:02.129319 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.129359 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 04:14:02.129454 25320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:37253: Network error: Client connection negotiation failed: client connection to 127.10.249.189:37253: connect: Connection refused (error 111)
I20260810 04:14:02.137748 25328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:02.139499 25328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:02.139665 25328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:02.143764 25328 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.189:37253
I20260810 04:14:02.143797 25400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.189:37253 every 8 connection(s)
I20260810 04:14:02.144157 25328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
I20260810 04:14:02.144965 25401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:02.146520 25401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:14:02.150167 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 25328
I20260810 04:14:02.150276 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-1/wal/instance
I20260810 04:14:02.150484 11238 external_mini_cluster.cc:1428] Setting key cec604d0b5203991bb72e0e9259c5966
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335242, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:02.156411 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.147104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:32911 (local address 127.0.0.1:38566)
0810 04:14:02.147339 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.147382 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:02.147860 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:02.148127 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:02.148130 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:02.148371 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:02.148561 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.148565 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.149434 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.149435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.150416 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.150418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.150883 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.150884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.151012 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.151534 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.151543 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.152926 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.155054 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.155063 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.155066 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.155316 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.155539 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.155540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.155541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.155637 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.155929 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.155933 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.156046 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.156126 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.156252 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":94,"threads_started":1}
I20260810 04:14:02.156419 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.147154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38566 (local address 127.10.249.190:32911)
0810 04:14:02.147266 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.147268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.147470 (+ 202us) server_negotiation.cc:407] Connection header received
0810 04:14:02.147980 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.147982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.147998 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.148055 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.148706 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.149323 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.150499 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.150765 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.150858 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.153022 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.153024 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.153024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.153032 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.154957 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.155397 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.155399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.155400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.155469 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.155705 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.155706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.155706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.155862 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.155943 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.156185 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.156280 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 04:14:02.157042 25401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.249.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.188@KRBTEST.COM" created.
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335242, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
I20260810 04:14:02.166262 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.157350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36328)
0810 04:14:02.157395 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.157406 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:02.157447 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:02.157738 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:02.157739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:02.157916 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:02.157963 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.157965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.159276 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.159277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.159822 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.159824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.160320 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.160320 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.160372 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.160707 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.160712 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.163408 (+ 2696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.165138 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.165139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.165140 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.165314 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.165537 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.165537 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.165538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.165592 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.165942 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.165943 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.165981 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.166047 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.166151 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 04:14:02.166296 25406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.157405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36328 (local address 127.10.249.189:37253)
0810 04:14:02.157574 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.157579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.157602 (+ 23us) server_negotiation.cc:407] Connection header received
0810 04:14:02.157627 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.157629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.157644 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.157729 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.158041 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.159187 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.159882 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.160251 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.160310 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.163511 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.163519 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.163519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.163526 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.165019 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.165407 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.165410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.165411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.165469 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.165666 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.165666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.165667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.165865 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.165965 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.166074 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.166195 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260810 04:14:02.167212 25401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:14:02.167583 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.167436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:39980)
0810 04:14:02.167491 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.167547 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 04:14:02.167747 25349 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
I20260810 04:14:02.168179 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.168058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:39982)
0810 04:14:02.168114 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.168149 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 04:14:02.168318 25401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:45727: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab.
Entry for principal kudu/127.10.249.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab.
I20260810 04:14:02.178963 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.188:45727
--webserver_interface=127.10.249.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab
--principal=kudu/127.10.249.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:34837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:32911,127.10.249.189:37253,127.10.249.188:45727
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:02.217568 25401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } attempt: 1
I20260810 04:14:02.218111 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.217970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:39998)
0810 04:14:02.218033 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.218076 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 04:14:02.218550 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.218399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40000)
0810 04:14:02.218466 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.218517 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 04:14:02.218679 25401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:45727: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
I20260810 04:14:02.220584 25320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } attempt: 3
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335241, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
I20260810 04:14:02.227586 25406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.220947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36332 (local address 127.10.249.189:37253)
0810 04:14:02.221008 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.221010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.221019 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:02.221045 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.221046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.221064 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.221126 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.221450 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.222044 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.222722 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.222948 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.223028 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.225110 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.225115 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.225116 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.225122 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.226629 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.227002 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.227003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.227003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.227048 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.227234 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.227234 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.227235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.227314 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.227354 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.227487 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.227540 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:14:02.227648 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.220852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36332)
0810 04:14:02.220907 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.220918 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:02.220980 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:02.221132 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:02.221133 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:02.221304 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:02.221369 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.221371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.222126 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.222128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.222632 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.222633 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.223029 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.223030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.223119 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.223595 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.223600 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.225007 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.226718 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.226719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.226720 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.226939 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.227107 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.227108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.227108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.227183 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.227362 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.227363 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.227408 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.227474 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.227568 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 04:14:02.228035 25320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:14:02.228340 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.228250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40004)
0810 04:14:02.228289 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.228320 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 04:14:02.228626 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.228548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40016)
0810 04:14:02.228590 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.228612 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 04:14:02.228709 25320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:45727: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
I20260810 04:14:02.259876 25320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } attempt: 1
I20260810 04:14:02.260422 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.260266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40022)
0810 04:14:02.260337 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.260386 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 04:14:02.260824 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.260714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40028)
0810 04:14:02.260764 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.260797 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:14:02.260962 25320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:45727: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
W20260810 04:14:02.264667 25409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:02.264843 25409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:02.264889 25409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:02.266106 25409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:02.266151 25409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:02.266166 25409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:02.266212 25409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:02.266229 25409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:02.267705 25409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:34837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:32911,127.10.249.189:37253,127.10.249.188:45727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab
--principal=kudu/127.10.249.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.188:45727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.249.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:02.267958 25409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:02.268191 25409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:02.273036 25415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:02.273051 25414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:02.273169 25409 server_base.cc:1034] running on GCE node
W20260810 04:14:02.273051 25417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:02.273468 25409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:02.273768 25409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:02.274968 25409 hybrid_clock.cc:648] HybridClock initialized: now 1786335242274960 us; error 31 us; skew 500 ppm
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335242, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:02.277318 25409 init.cc:377] Logged in from keytab as kudu/127.10.249.188@KRBTEST.COM (short username kudu)
I20260810 04:14:02.277776 25409 webserver.cc:460] Webserver started at http://127.10.249.188:33477/ using document root <none> and password file <none>
I20260810 04:14:02.278038 25409 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:02.278085 25409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:02.278173 25409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:02.279153 25409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/data/instance:
uuid: "ed5844f239974264a12476665055e329"
format_stamp: "Formatted at 2026-08-10 04:14:02 on dist-test-slave-0kls"
server_key: "f29d31b03c051b5e27d5bd4f5d6b9032"
server_key_iv: "343e848239cd6dd2a2aea2a9645cca81"
server_key_version: "encryptionkey@0"
I20260810 04:14:02.279564 25409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/wal/instance:
uuid: "ed5844f239974264a12476665055e329"
format_stamp: "Formatted at 2026-08-10 04:14:02 on dist-test-slave-0kls"
server_key: "f29d31b03c051b5e27d5bd4f5d6b9032"
server_key_iv: "343e848239cd6dd2a2aea2a9645cca81"
server_key_version: "encryptionkey@0"
I20260810 04:14:02.280854 25409 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:14:02.281525 25425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:02.281715 25409 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:14:02.281854 25409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/wal
uuid: "ed5844f239974264a12476665055e329"
format_stamp: "Formatted at 2026-08-10 04:14:02 on dist-test-slave-0kls"
server_key: "f29d31b03c051b5e27d5bd4f5d6b9032"
server_key_iv: "343e848239cd6dd2a2aea2a9645cca81"
server_key_version: "encryptionkey@0"
I20260810 04:14:02.281932 25409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:02.286808 25401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } attempt: 2
I20260810 04:14:02.287189 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.287060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40038)
0810 04:14:02.287127 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.287162 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 04:14:02.287581 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.287496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40042)
0810 04:14:02.287537 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.287566 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 04:14:02.287683 25401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:45727: Network error: Client connection negotiation failed: client connection to 127.10.249.188:45727: connect: Connection refused (error 111)
I20260810 04:14:02.313474 25409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:02.315821 25409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:02.315981 25409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:02.319849 25409 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.188:45727
I20260810 04:14:02.319914 25481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.188:45727 every 8 connection(s)
I20260810 04:14:02.320277 25409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
I20260810 04:14:02.321260 25482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:02.322865 25482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:14:02.324648 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 25409
I20260810 04:14:02.324775 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786335069075394-11238-0/minicluster-data/master-2/wal/instance
I20260810 04:14:02.324951 11238 external_mini_cluster.cc:1428] Setting key d8b71b9a162f31740dff97657741ba18
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335242, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
I20260810 04:14:02.333536 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.323609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38572 (local address 127.10.249.190:32911)
0810 04:14:02.323697 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.323699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.323877 (+ 178us) server_negotiation.cc:407] Connection header received
0810 04:14:02.324337 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.324338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.324348 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.324399 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.325036 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.325713 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.327010 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.327829 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.327926 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.330331 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.330332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.330333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.330342 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.331989 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.332492 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.332493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.332493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.332580 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.332862 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.332863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.332863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.333010 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.333091 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.333363 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.333443 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:14:02.333847 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.325325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40052 (local address 127.10.249.188:45727)
0810 04:14:02.325498 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.325503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.325558 (+ 55us) server_negotiation.cc:407] Connection header received
0810 04:14:02.325629 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.325631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.325649 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.325715 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.326409 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.327203 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.327895 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.328246 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.328313 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.330838 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.330846 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.330846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.330853 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.332508 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.332846 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.332849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.332850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.332917 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.333130 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.333131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.333132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.333275 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.333431 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.333513 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.333592 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
I20260810 04:14:02.333850 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.323570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:32911 (local address 127.0.0.1:38572)
0810 04:14:02.323754 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.323792 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:02.324262 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:02.324464 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:02.324468 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:02.324685 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:02.324948 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.324952 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.325831 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.325833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.326936 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.326940 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.327951 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.327952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.328062 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.328569 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.328580 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.330244 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.332071 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.332078 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.332080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.332417 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.332672 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.332673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.332674 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.332782 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.333083 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.333091 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.333227 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.333340 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.333487 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":99,"threads_started":1}
I20260810 04:14:02.334532 25482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:14:02.336117 25320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } attempt: 2
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335242, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335241, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
I20260810 04:14:02.342496 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.334782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:37253 (local address 127.0.0.1:36348)
0810 04:14:02.334847 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.334859 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:02.334900 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:02.335026 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:02.335027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:02.335140 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:02.335188 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.335190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.335885 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.335886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.336600 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.336603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.336966 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.336967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.337043 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.337659 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.337664 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.339261 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.341069 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.341072 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.341072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.341247 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.341688 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.341689 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.341689 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.341757 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.342139 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.342140 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.342206 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.342294 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.342408 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 04:14:02.342501 25406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.334875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36348 (local address 127.10.249.189:37253)
0810 04:14:02.334918 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.334919 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.334927 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:14:02.334953 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.334954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.334963 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.335023 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.335267 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.335815 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.336701 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.336896 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.336970 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.339389 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.339390 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.339390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.339398 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.340973 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.341326 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.341327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.341328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.341384 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.341929 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.341931 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.341931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.342082 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.342164 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.342330 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.342420 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:14:02.342943 25482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:14:02.343542 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.334734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38582 (local address 127.10.249.190:32911)
0810 04:14:02.334869 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.334871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.334878 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:14:02.334899 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.334900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.334910 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.334962 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.335503 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.335995 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.337250 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.337503 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.337556 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.340085 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.340086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.340087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.340094 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.341731 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.342139 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.342140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.342141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.342215 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.342445 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.342446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.342447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.342597 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.342887 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.343323 (+ 436us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.343421 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260810 04:14:02.344748 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.336405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40068)
0810 04:14:02.336492 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.336503 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:02.336561 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:02.336702 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:02.336703 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:02.336851 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:02.336886 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.336888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.337627 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.337628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.338530 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.338533 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.338928 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.338929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.338986 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.339642 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.339647 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.341128 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.343433 (+ 2305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.343434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.343435 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.343697 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.343914 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.343915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.343916 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.343990 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.344468 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.344469 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.344509 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.344577 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.344655 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 04:14:02.344792 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.336444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40068 (local address 127.10.249.188:45727)
0810 04:14:02.336478 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.336480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.336538 (+ 58us) server_negotiation.cc:407] Connection header received
0810 04:14:02.336617 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.336618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.336628 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.336950 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.336976 (+ 26us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.337523 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.338633 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.338842 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.338925 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.341236 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.341237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.341238 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.341244 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.343357 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.343774 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.343775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.343775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.343827 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.344231 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.344233 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.344233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.344358 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.344469 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.344617 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.344689 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:14:02.346276 25320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: Bootstrap starting.
I20260810 04:14:02.347019 25320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:02.347313 25320 log.cc:824] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: Log is configured to *not* fsync() on all Append() calls
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335242, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
I20260810 04:14:02.348008 25320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: No bootstrap required, opened a new log
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
I20260810 04:14:02.349864 25320 raft_consensus.cc:348] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.350008 25320 raft_consensus.cc:374] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:02.350054 25320 raft_consensus.cc:729] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 785d065533d34f129b083f0c70bc6720, State: Initialized, Role: FOLLOWER
I20260810 04:14:02.350232 25320 consensus_queue.cc:260] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.350598 25320 sys_catalog.cc:564] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:02.350992 25489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.351151 25489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:14:02.351303 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.343243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40078 (local address 127.10.249.188:45727)
0810 04:14:02.343426 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.343428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.343531 (+ 103us) server_negotiation.cc:407] Connection header received
0810 04:14:02.343547 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.343547 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.343555 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.343617 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.343907 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.345071 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.345958 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.346245 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.346318 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.348313 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.348315 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.348315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.348320 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.349893 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.350475 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.350476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.350476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.350530 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.350754 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.350755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.350755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.350914 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.350969 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.351124 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.351192 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":106,"threads_started":1}
I20260810 04:14:02.351514 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.343188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40078)
0810 04:14:02.343439 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.343448 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:02.343482 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:02.343651 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:02.343652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:02.343790 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:02.343821 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.343823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.345151 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.345151 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.345878 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.345881 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.346338 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.346339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.346390 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.347009 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.347014 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.348229 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.349972 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.349972 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.349973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.350408 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.350606 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.350607 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.350608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.350671 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.350990 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.350991 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.351023 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.351372 (+ 349us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.351448 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237}
I20260810 04:14:02.352120 25406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.344272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36350 (local address 127.10.249.189:37253)
0810 04:14:02.344309 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.344311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.344318 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:14:02.344338 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.344339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.344349 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.344415 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.345223 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.345930 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.346670 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.346874 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.346941 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.349301 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.349302 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.349303 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.349309 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.350832 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.351220 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.351221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.351222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.351281 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.351490 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.351491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.351491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.351594 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.351745 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.351973 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.352045 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:14:02.352661 25500 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:14:02.352771 25500 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:14:02.352806 25482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329: Bootstrap starting.
I20260810 04:14:02.353483 25482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:02.353663 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:14:02.353777 25482 log.cc:824] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:02.354909 25482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329: No bootstrap required, opened a new log
I20260810 04:14:02.356806 25482 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.356930 25482 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:02.356958 25482 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5844f239974264a12476665055e329, State: Initialized, Role: FOLLOWER
I20260810 04:14:02.357059 25482 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.357318 25510 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.357441 25510 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:14:02.357321 25482 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:02.358242 25244 master_runner.cc:186] Error getting master registration for 127.10.249.189:37253: OK, instance_id { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" instance_seqno: 1786335242142604 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:14:02.360436 25244 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:14:02.361186 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.355184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.10.249.188:45727)
0810 04:14:02.355219 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.355221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.355342 (+ 121us) server_negotiation.cc:407] Connection header received
0810 04:14:02.355433 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.355434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.355463 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.355493 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.356184 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.356593 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.357267 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.357524 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.357580 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.358780 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.358782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.358782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.358789 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.360048 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.360396 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.360397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.360397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.360454 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.360674 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.360675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.360675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.360779 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.360898 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.360989 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.361071 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:14:02.362185 25522 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:14:02.362288 25522 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:14:02.363417 25409 master_runner.cc:186] Error getting master registration for 127.10.249.189:37253: OK, instance_id { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" instance_seqno: 1786335242142604 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:14:02.365666 25409 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:14:02.370265 25406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.355742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36360 (local address 127.10.249.189:37253)
0810 04:14:02.355777 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.355779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.362569 (+ 6790us) server_negotiation.cc:407] Connection header received
0810 04:14:02.362660 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.362661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.362670 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.362695 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.363396 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.364142 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.365155 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.365414 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.365451 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.367456 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.367457 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.367458 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.367464 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.369016 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.369400 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.369401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.369401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.369463 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.369678 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.369679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.369680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.369833 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.369900 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.370096 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.370175 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:14:02.373384 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.355412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38596 (local address 127.10.249.190:32911)
0810 04:14:02.355464 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.355466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.361746 (+ 6280us) server_negotiation.cc:407] Connection header received
0810 04:14:02.362430 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.362431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.362441 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.362471 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.366547 (+ 4076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.367268 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.368718 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.368982 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.369019 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.370467 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.370468 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.370469 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.370476 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.372126 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.372544 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.372545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.372545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.372606 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.372822 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.372823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.372823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.372980 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.373083 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.373210 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.373288 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:14:02.378816 25401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } attempt: 3
Aug 10 04:14:02 dist-test-slave-0kls krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335242, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
I20260810 04:14:02.387271 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.379086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:45727 (local address 127.0.0.1:40096)
0810 04:14:02.379131 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:02.379141 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:02.379174 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:02.379432 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:02.379433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:02.379587 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:02.379627 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.379629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.380561 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.380563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.381361 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:02.381364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.381891 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.381893 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:02.381951 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.382343 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:02.382348 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:02.384220 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:02.386192 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.386193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.386194 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.386390 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.386622 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:02.386623 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:02.386623 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:02.386693 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:02.386960 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:02.386961 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:02.387002 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 04:14:02.387069 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 04:14:02.387172 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 04:14:02.387303 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:02.379255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40096 (local address 127.10.249.188:45727)
0810 04:14:02.379312 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:02.379314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:02.379323 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:02.379344 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:02.379345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:02.379355 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:02.379415 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:02.379702 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.380474 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.381460 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:02.381765 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:02.381870 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:02.384291 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:02.384292 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:02.384292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:02.384300 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:02.386113 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.386464 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.386465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.386466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.386539 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:02.386760 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:02.386761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:02.386762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:02.386896 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:02.386957 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:02.387141 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 04:14:02.387214 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:14:02.389308 25401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: Bootstrap starting.
I20260810 04:14:02.390149 25401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:02.390453 25401 log.cc:824] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:02.391396 25401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: No bootstrap required, opened a new log
I20260810 04:14:02.393428 25401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.393570 25401 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:02.393606 25401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e69771749894cfba5f75cafb54f6df0, State: Initialized, Role: FOLLOWER
I20260810 04:14:02.393847 25401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.394250 25401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:02.394217 25525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.394444 25525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:14:02.396219 25536 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:14:02.396311 25536 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:14:02.398357 25328 master_runner.cc:263] No leader master found from master 8e69771749894cfba5f75cafb54f6df0
I20260810 04:14:02.398404 25328 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 04:14:02.491071 25270 tablet.cc:2369] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:14:02.566617 25432 tablet.cc:2369] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:14:02.640453 25351 tablet.cc:2369] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:14:02.698202 25510 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:14:02.698313 25510 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.698637 25510 leader_election.cc:288] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 785d065533d34f129b083f0c70bc6720 (127.10.249.190:32911), 8e69771749894cfba5f75cafb54f6df0 (127.10.249.189:37253)
I20260810 04:14:02.698944 25374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5844f239974264a12476665055e329" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e69771749894cfba5f75cafb54f6df0" is_pre_election: true
I20260810 04:14:02.698942 25292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5844f239974264a12476665055e329" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "785d065533d34f129b083f0c70bc6720" is_pre_election: true
I20260810 04:14:02.699069 25292 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed5844f239974264a12476665055e329 in term 0.
I20260810 04:14:02.699092 25374 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed5844f239974264a12476665055e329 in term 0.
I20260810 04:14:02.699311 25427 leader_election.cc:302] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 785d065533d34f129b083f0c70bc6720, ed5844f239974264a12476665055e329; no voters:
I20260810 04:14:02.699462 25510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:14:02.699537 25510 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:14:02.699568 25510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:02.700295 25510 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.700467 25510 leader_election.cc:288] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [CANDIDATE]: Term 1 election: Requested vote from peers 785d065533d34f129b083f0c70bc6720 (127.10.249.190:32911), 8e69771749894cfba5f75cafb54f6df0 (127.10.249.189:37253)
I20260810 04:14:02.700603 25374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5844f239974264a12476665055e329" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e69771749894cfba5f75cafb54f6df0"
I20260810 04:14:02.700634 25292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed5844f239974264a12476665055e329" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "785d065533d34f129b083f0c70bc6720"
I20260810 04:14:02.700686 25374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:02.700733 25292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:02.701455 25374 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed5844f239974264a12476665055e329 in term 1.
I20260810 04:14:02.701471 25292 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed5844f239974264a12476665055e329 in term 1.
I20260810 04:14:02.701617 25426 leader_election.cc:302] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e69771749894cfba5f75cafb54f6df0, ed5844f239974264a12476665055e329; no voters:
I20260810 04:14:02.701752 25510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:14:02.701902 25510 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [term 1 LEADER]: Becoming Leader. State: Replica: ed5844f239974264a12476665055e329, State: Running, Role: LEADER
I20260810 04:14:02.702018 25510 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } }
I20260810 04:14:02.702426 25539 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed5844f239974264a12476665055e329. Latest consensus state: current_term: 1 leader_uuid: "ed5844f239974264a12476665055e329" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.702521 25539 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:02.702711 25541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:14:02.702894 25541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:14:02.704239 25374 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [term 1 FOLLOWER]: Refusing update from remote peer ed5844f239974264a12476665055e329: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:02.704363 25292 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [term 1 FOLLOWER]: Refusing update from remote peer ed5844f239974264a12476665055e329: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:02.704568 25539 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:02.704707 25510 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [LEADER]: Connected to new peer: Peer: permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:02.705830 25525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed5844f239974264a12476665055e329. Latest consensus state: current_term: 1 leader_uuid: "ed5844f239974264a12476665055e329" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.705935 25525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:14:02.705967 25489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed5844f239974264a12476665055e329. Latest consensus state: current_term: 1 leader_uuid: "ed5844f239974264a12476665055e329" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.706050 25489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:14:02.706830 25510 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ed5844f239974264a12476665055e329" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.706918 25510 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:02.706955 25510 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ed5844f239974264a12476665055e329" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.707013 25510 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:02.707067 25542 mvcc.cc:205] Tried to move back new op lower bound from 7316829154114334720 to 7316829154108092416. Current Snapshot: MvccSnapshot[applied={T|T < 7316829154114334720}]
I20260810 04:14:02.707319 25541 catalog_manager.cc:1347] Generated new cluster ID: f4bb7efffe9745e98446424e776afd02
I20260810 04:14:02.707363 25541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:14:02.707362 25525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ed5844f239974264a12476665055e329" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.707420 25525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:14:02.707486 25489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ed5844f239974264a12476665055e329" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "785d065533d34f129b083f0c70bc6720" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 32911 } } peers { permanent_uuid: "8e69771749894cfba5f75cafb54f6df0" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 37253 } } peers { permanent_uuid: "ed5844f239974264a12476665055e329" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 45727 } } }
I20260810 04:14:02.707504 25545 mvcc.cc:205] Tried to move back new op lower bound from 7316829154114334720 to 7316829154108092416. Current Snapshot: MvccSnapshot[applied={T|T < 7316829154114334720}]
I20260810 04:14:02.707587 25489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:14:02.707559 25543 mvcc.cc:205] Tried to move back new op lower bound from 7316829154114334720 to 7316829154108092416. Current Snapshot: MvccSnapshot[applied={T|T < 7316829154114334720}]
I20260810 04:14:02.730361 25541 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:14:02.730989 25541 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:14:02.740108 25541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed5844f239974264a12476665055e329: Generated new TSK 0
I20260810 04:14:02.740281 25541 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:14:03.353263 25500 catalog_manager.cc:1259] Loaded cluster ID: f4bb7efffe9745e98446424e776afd02
I20260810 04:14:03.353330 25500 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: loading cluster ID for follower catalog manager: success
I20260810 04:14:03.354123 25500 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: acquiring CA information for follower catalog manager: success
I20260810 04:14:03.354393 25500 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 785d065533d34f129b083f0c70bc6720: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:14:03.396770 25536 catalog_manager.cc:1259] Loaded cluster ID: f4bb7efffe9745e98446424e776afd02
I20260810 04:14:03.396852 25536 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: loading cluster ID for follower catalog manager: success
I20260810 04:14:03.397660 25536 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: acquiring CA information for follower catalog manager: success
I20260810 04:14:03.397944 25536 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8e69771749894cfba5f75cafb54f6df0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:14:03.804641 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 25244
I20260810 04:14:03.812340 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 25328
I20260810 04:14:03.818130 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 25409
2026-08-10T04:14:03Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3069 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:14:03 dist-test-slave-0kls krb5kdc[25558](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:14:03 dist-test-slave-0kls krb5kdc[25558](info): set up 2 sockets
Aug 10 04:14:03 dist-test-slave-0kls krb5kdc[25558](info): commencing operation
krb5kdc: starting...
W20260810 04:14:04.802235 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.964s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:14:04 dist-test-slave-0kls krb5kdc[25558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:14:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:14:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:14:04.914861 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:44035
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:40905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:44035
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:04.992998 25573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:04.993206 25573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:04.993228 25573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:04.994479 25573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:04.994518 25573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:04.994531 25573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:04.994544 25573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:04.994589 25573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:04.995982 25573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:44035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:44035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:04.996182 25573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:04.996378 25573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:05.001036 25579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:05.001019 25580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:05.001183 25573 server_base.cc:1034] running on GCE node
W20260810 04:14:05.001030 25582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:05.001420 25573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:05.001722 25573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:05.002858 25573 hybrid_clock.cc:648] HybridClock initialized: now 1786335245002850 us; error 25 us; skew 500 ppm
Aug 10 04:14:04 dist-test-slave-0kls krb5kdc[25558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335244, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:05.005342 25573 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:14:05.005723 25573 webserver.cc:460] Webserver started at http://127.10.249.190:37679/ using document root <none> and password file <none>
I20260810 04:14:05.006014 25573 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:05.006059 25573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:05.006147 25573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:05.007118 25573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "22dfc607e2cf42ad9821257c630945a8"
format_stamp: "Formatted at 2026-08-10 04:14:05 on dist-test-slave-0kls"
server_key: "9ee009440f3a4302d637982429cd0018"
server_key_iv: "13b49227027cebb2785088789ad484b3"
server_key_version: "encryptionkey@0"
I20260810 04:14:05.007422 25573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "22dfc607e2cf42ad9821257c630945a8"
format_stamp: "Formatted at 2026-08-10 04:14:05 on dist-test-slave-0kls"
server_key: "9ee009440f3a4302d637982429cd0018"
server_key_iv: "13b49227027cebb2785088789ad484b3"
server_key_version: "encryptionkey@0"
I20260810 04:14:05.008549 25573 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:14:05.009157 25590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:05.009306 25573 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:14:05.009409 25573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "22dfc607e2cf42ad9821257c630945a8"
format_stamp: "Formatted at 2026-08-10 04:14:05 on dist-test-slave-0kls"
server_key: "9ee009440f3a4302d637982429cd0018"
server_key_iv: "13b49227027cebb2785088789ad484b3"
server_key_version: "encryptionkey@0"
I20260810 04:14:05.009459 25573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:05.020987 25573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:05.023113 25573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:05.023221 25573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:05.026964 25573 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:44035
I20260810 04:14:05.027012 25645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:44035 every 8 connection(s)
I20260810 04:14:05.027310 25573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:14:05.028095 25646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:05.030022 25646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8: Bootstrap starting.
I20260810 04:14:05.030246 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 25573
I20260810 04:14:05.030344 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:14:05.030527 11238 external_mini_cluster.cc:1428] Setting key b4ca236e25106928fc1db20e03e72a32
I20260810 04:14:05.030663 25646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:05.030968 25646 log.cc:824] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:05.031625 25646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8: No bootstrap required, opened a new log
I20260810 04:14:05.033779 25646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22dfc607e2cf42ad9821257c630945a8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44035 } }
I20260810 04:14:05.033970 25646 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:05.033999 25646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22dfc607e2cf42ad9821257c630945a8, State: Initialized, Role: FOLLOWER
I20260810 04:14:05.034143 25646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22dfc607e2cf42ad9821257c630945a8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44035 } }
I20260810 04:14:05.034217 25646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:14:05.034240 25646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:14:05.034318 25646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:05.034883 25646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22dfc607e2cf42ad9821257c630945a8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44035 } }
I20260810 04:14:05.034996 25646 leader_election.cc:302] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22dfc607e2cf42ad9821257c630945a8; no voters:
I20260810 04:14:05.035135 25646 leader_election.cc:288] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:14:05.035200 25651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:14:05.035364 25646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:05.035365 25651 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [term 1 LEADER]: Becoming Leader. State: Replica: 22dfc607e2cf42ad9821257c630945a8, State: Running, Role: LEADER
I20260810 04:14:05.035854 25651 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22dfc607e2cf42ad9821257c630945a8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44035 } }
I20260810 04:14:05.036526 25652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22dfc607e2cf42ad9821257c630945a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22dfc607e2cf42ad9821257c630945a8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44035 } } }
I20260810 04:14:05.036749 25653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22dfc607e2cf42ad9821257c630945a8. Latest consensus state: current_term: 1 leader_uuid: "22dfc607e2cf42ad9821257c630945a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22dfc607e2cf42ad9821257c630945a8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44035 } } }
I20260810 04:14:05.037082 25653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:05.036836 25652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8 [sys.catalog]: This master's current role is: LEADER
W20260810 04:14:05.037340 25666 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:14:05.037406 25666 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 04:14:05 dist-test-slave-0kls krb5kdc[25558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:05.037946 25668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:14:05.038144 25668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:14:05.039682 25668 catalog_manager.cc:1347] Generated new cluster ID: e5a1609efa8c4f45b9be764074d3d9b4
I20260810 04:14:05.039732 25668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:14:05.042043 25649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:05.030951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60636 (local address 127.10.249.190:44035)
0810 04:14:05.031124 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:05.031132 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:05.031161 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:14:05.031644 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:05.031652 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:05.031708 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:05.031845 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:05.032335 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:05.033735 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:05.034656 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:05.035240 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:05.035617 (+ 377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:05.038009 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:05.038014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:05.038014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:05.038026 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:05.039994 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:05.040415 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:05.040418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:05.040419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:05.040518 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:05.040750 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:05.040751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:05.040751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:05.041069 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:05.041215 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:05.041691 (+ 476us) server_negotiation.cc:299] Negotiation successful
0810 04:14:05.041849 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":70,"threads_started":1}
I20260810 04:14:05.042910 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:14:05.048282 25668 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:14:05.048754 25668 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:14:05.053649 25668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22dfc607e2cf42ad9821257c630945a8: Generated new TSK 0
I20260810 04:14:05.053848 25668 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:14:05.096796 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 25573
2026-08-10T04:14:05Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1278 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:14:05 dist-test-slave-0kls krb5kdc[25673](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:14:05 dist-test-slave-0kls krb5kdc[25673](info): set up 2 sockets
Aug 10 04:14:05 dist-test-slave-0kls krb5kdc[25673](info): commencing operation
krb5kdc: starting...
W20260810 04:14:06.095091 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.979s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:14:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:14:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:14:06.208281 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:45857
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:45857
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:06.281693 25687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:06.281939 25687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:06.281977 25687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:06.283097 25687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:06.283169 25687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:06.283227 25687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:06.283260 25687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:06.283283 25687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:06.284715 25687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:45857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:45857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:06.284974 25687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:06.285178 25687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:06.289402 25693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:06.289463 25696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:06.289471 25694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:06.289549 25687 server_base.cc:1034] running on GCE node
I20260810 04:14:06.290006 25687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:06.290247 25687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:06.291383 25687 hybrid_clock.cc:648] HybridClock initialized: now 1786335246291371 us; error 26 us; skew 500 ppm
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:06.299492 25687 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:14:06.299932 25687 webserver.cc:460] Webserver started at http://127.10.249.190:41515/ using document root <none> and password file <none>
I20260810 04:14:06.300170 25687 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:06.300228 25687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:06.300390 25687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:06.301421 25687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "daef6723510d47c587a2d59faa1cacd9"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "2b5f2ae093f5bcb73b2f606f37309d04"
server_key_iv: "d5b5a17ab4c2f8a1f2fc0ecc7f7c9d97"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.301777 25687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "daef6723510d47c587a2d59faa1cacd9"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "2b5f2ae093f5bcb73b2f606f37309d04"
server_key_iv: "d5b5a17ab4c2f8a1f2fc0ecc7f7c9d97"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.303139 25687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:14:06.303891 25703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.304082 25687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:14:06.304189 25687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "daef6723510d47c587a2d59faa1cacd9"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "2b5f2ae093f5bcb73b2f606f37309d04"
server_key_iv: "d5b5a17ab4c2f8a1f2fc0ecc7f7c9d97"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.304260 25687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:06.315907 25687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:06.317574 25687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:06.317724 25687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:06.321523 25687 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:45857
I20260810 04:14:06.321558 25759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:45857 every 8 connection(s)
I20260810 04:14:06.321954 25687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:14:06.322168 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 25687
I20260810 04:14:06.322281 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:14:06.322456 11238 external_mini_cluster.cc:1428] Setting key 017500cab9df969d11054a451d1ab72e
I20260810 04:14:06.323037 25760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:06.325402 25760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Bootstrap starting.
I20260810 04:14:06.325999 25760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:06.326283 25760 log.cc:824] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:06.327072 25760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: No bootstrap required, opened a new log
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:06.329051 25760 raft_consensus.cc:348] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:06.329213 25760 raft_consensus.cc:374] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:06.329257 25760 raft_consensus.cc:729] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daef6723510d47c587a2d59faa1cacd9, State: Initialized, Role: FOLLOWER
I20260810 04:14:06.329416 25760 consensus_queue.cc:260] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:06.329514 25760 raft_consensus.cc:388] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:14:06.329536 25760 raft_consensus.cc:482] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:14:06.329603 25760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:06.330235 25760 raft_consensus.cc:504] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:06.330320 25760 leader_election.cc:302] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daef6723510d47c587a2d59faa1cacd9; no voters:
I20260810 04:14:06.330525 25760 leader_election.cc:288] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:14:06.330554 25765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:14:06.330690 25765 raft_consensus.cc:686] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 1 LEADER]: Becoming Leader. State: Replica: daef6723510d47c587a2d59faa1cacd9, State: Running, Role: LEADER
I20260810 04:14:06.330803 25760 sys_catalog.cc:564] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:06.330826 25765 consensus_queue.cc:237] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:06.331216 25765 sys_catalog.cc:455] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daef6723510d47c587a2d59faa1cacd9. Latest consensus state: current_term: 1 leader_uuid: "daef6723510d47c587a2d59faa1cacd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } } }
I20260810 04:14:06.331362 25765 sys_catalog.cc:458] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:06.331607 25774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:14:06.331229 25766 sys_catalog.cc:455] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "daef6723510d47c587a2d59faa1cacd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } } }
I20260810 04:14:06.331990 25766 sys_catalog.cc:458] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:06.332036 25774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:14:06.332584 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.322915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33048 (local address 127.10.249.190:45857)
0810 04:14:06.323102 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:06.323111 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:06.323141 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:14:06.323601 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:06.323607 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:06.323650 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:06.323796 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:06.324418 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.325216 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.326047 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.326568 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.326685 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.328904 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:06.328908 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:06.328909 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:06.328918 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:06.330761 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.331177 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.331180 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.331180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.331280 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.331474 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.331474 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.331475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.331763 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:06.331898 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:06.332264 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 04:14:06.332393 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260810 04:14:06.333671 25774 catalog_manager.cc:1347] Generated new cluster ID: 601e3e195ccf4be6b9a7ebde9f3b711f
I20260810 04:14:06.333724 25774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:14:06.347438 25774 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:14:06.347869 25774 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:14:06.351357 25774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Generated new TSK 0
I20260810 04:14:06.351504 25774 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:14:06.377053 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:45857
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:06.453851 25786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:06.454042 25786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:06.454066 25786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:06.455104 25786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:06.455142 25786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:06.455163 25786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:14:06.456487 25786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:06.456732 25786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:06.456949 25786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:06.461585 25794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:06.461612 25786 server_base.cc:1034] running on GCE node
W20260810 04:14:06.461561 25792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:06.461583 25791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:06.462059 25786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:06.462284 25786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:06.463454 25786 hybrid_clock.cc:648] HybridClock initialized: now 1786335246463450 us; error 32 us; skew 500 ppm
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:06.466378 25786 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:14:06.466811 25786 webserver.cc:460] Webserver started at http://127.10.249.129:34851/ using document root <none> and password file <none>
I20260810 04:14:06.467010 25786 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:06.467049 25786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:06.467133 25786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:06.468055 25786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "6bb2d4e7de894f019a7ae290cc31c6e7"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "e34c642f3f696fb16ad4abff3b40bb2c"
server_key_iv: "c750b99287890c13267a968ea6879136"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.468329 25786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "6bb2d4e7de894f019a7ae290cc31c6e7"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "e34c642f3f696fb16ad4abff3b40bb2c"
server_key_iv: "c750b99287890c13267a968ea6879136"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.469405 25786 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:14:06.470046 25802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.470197 25786 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:06.470279 25786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "6bb2d4e7de894f019a7ae290cc31c6e7"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "e34c642f3f696fb16ad4abff3b40bb2c"
server_key_iv: "c750b99287890c13267a968ea6879136"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.470331 25786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:06.484748 25786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:06.486868 25786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:06.486964 25786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:06.487120 25786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:06.487404 25786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:06.487435 25786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.487454 25786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:06.487494 25786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.492653 25786 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:38093
I20260810 04:14:06.492746 25920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:38093 every 8 connection(s)
I20260810 04:14:06.493009 25786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:06.501452 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 25786
I20260810 04:14:06.501570 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:14:06.501825 11238 external_mini_cluster.cc:1428] Setting key c9664e051543459b40fe81d5116a9106
I20260810 04:14:06.502032 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.493769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:55107 (local address 127.10.249.190:45857)
0810 04:14:06.493859 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:06.493861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:06.494065 (+ 204us) server_negotiation.cc:407] Connection header received
0810 04:14:06.494623 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:06.494624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:06.494635 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:06.494705 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:06.495586 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.496032 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.496986 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.497180 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.497250 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.499313 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:06.499314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:06.499315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:06.499323 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:06.500543 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.500957 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.500959 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.500959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.501035 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.501280 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.501281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.501281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.501392 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:06.501458 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:06.501835 (+ 377us) server_negotiation.cc:299] Negotiation successful
0810 04:14:06.501917 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 04:14:06.502334 25923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.493732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:55107)
0810 04:14:06.493920 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:06.493968 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:06.494516 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:06.494776 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:06.494780 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:06.495303 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:06.495474 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.495478 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.496139 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.496140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.496892 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.496894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.497297 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.497298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.497439 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.497917 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:06.497925 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:06.499211 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:06.500637 (+ 1426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:06.500645 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:06.500647 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:06.500866 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:06.501103 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:06.501104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:06.501104 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:06.501209 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:06.501460 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:06.501468 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:06.501655 (+ 187us) client_negotiation.cc:769] Sending connection context
0810 04:14:06.501788 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 04:14:06.502115 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
I20260810 04:14:06.502835 25921 heartbeater.cc:347] Connected to a master server at 127.10.249.190:45857
I20260810 04:14:06.502924 25921 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:06.503104 25921 heartbeater.cc:511] Master 127.10.249.190:45857 requested a full tablet report, sending...
I20260810 04:14:06.503685 25722 ts_manager.cc:194] Registered new tserver with Master: 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093)
I20260810 04:14:06.504289 25722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:55107
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:14:06.526467 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:45857
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:06.611295 25926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:06.611479 25926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:06.611506 25926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:06.612627 25926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:06.612671 25926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:06.612725 25926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:14:06.614255 25926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:06.614498 25926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:06.614727 25926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:06.619526 25934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:06.619702 25931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:06.619665 25926 server_base.cc:1034] running on GCE node
W20260810 04:14:06.619580 25932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:06.620363 25926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:06.620620 25926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:06.621773 25926 hybrid_clock.cc:648] HybridClock initialized: now 1786335246621762 us; error 27 us; skew 500 ppm
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:06.624313 25926 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:14:06.624663 25926 webserver.cc:460] Webserver started at http://127.10.249.130:33181/ using document root <none> and password file <none>
I20260810 04:14:06.624840 25926 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:06.624876 25926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:06.624956 25926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:06.625902 25926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "f294539b15214f77b0887f2d61b147d4"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "72c3b572488391a0fec5884acf30bb8d"
server_key_iv: "9e012c6eb2b1514c757b117d525bbabc"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.626195 25926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "f294539b15214f77b0887f2d61b147d4"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "72c3b572488391a0fec5884acf30bb8d"
server_key_iv: "9e012c6eb2b1514c757b117d525bbabc"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.627327 25926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:06.627946 25943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.628123 25926 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:06.628206 25926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "f294539b15214f77b0887f2d61b147d4"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "72c3b572488391a0fec5884acf30bb8d"
server_key_iv: "9e012c6eb2b1514c757b117d525bbabc"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.628257 25926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:06.643324 25926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:06.645012 25926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:06.645155 25926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:06.645378 25926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:06.645660 25926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:06.645720 25926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.645757 25926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:06.645802 25926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.651113 25926 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:35759
I20260810 04:14:06.651211 26063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:35759 every 8 connection(s)
I20260810 04:14:06.651485 25926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:06.659691 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.652268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:38247 (local address 127.10.249.190:45857)
0810 04:14:06.652330 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:06.652332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:06.652532 (+ 200us) server_negotiation.cc:407] Connection header received
0810 04:14:06.652979 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:06.652980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:06.652990 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:06.653034 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:06.653941 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.654424 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.655307 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.655473 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.655520 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.657419 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:06.657420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:06.657421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:06.657427 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:06.658587 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.658944 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.658945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.658945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.658993 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.659209 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.659209 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.659209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.659304 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:06.659354 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:06.659564 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 04:14:06.659625 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 04:14:06.659848 26066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.652239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:38247)
0810 04:14:06.652411 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:06.652444 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:06.652902 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:06.653087 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:06.653090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:06.653665 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:06.653864 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.653869 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.654513 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.654514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.655234 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.655236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.655539 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.655540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.655627 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.656083 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:06.656091 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:06.657337 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:06.658656 (+ 1319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:06.658661 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:06.658663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:06.658868 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:06.659048 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:06.659049 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:06.659050 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:06.659137 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:06.659357 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:06.659361 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:06.659461 (+ 100us) client_negotiation.cc:769] Sending connection context
0810 04:14:06.659538 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:14:06.659654 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260810 04:14:06.660373 26064 heartbeater.cc:347] Connected to a master server at 127.10.249.190:45857
I20260810 04:14:06.660473 26064 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:06.660641 26064 heartbeater.cc:511] Master 127.10.249.190:45857 requested a full tablet report, sending...
I20260810 04:14:06.661062 25722 ts_manager.cc:194] Registered new tserver with Master: f294539b15214f77b0887f2d61b147d4 (127.10.249.130:35759)
I20260810 04:14:06.661489 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 25926
I20260810 04:14:06.661496 25722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:38247
I20260810 04:14:06.661617 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:14:06.661846 11238 external_mini_cluster.cc:1428] Setting key 58e99f5862a9bb8ad4efa260e51a91a7
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:14:06.722728 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:45857
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:06.796612 26069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:06.796800 26069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:06.796835 26069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:06.797852 26069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:06.797904 26069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:06.797941 26069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:14:06.799216 26069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:06.799446 26069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:06.799638 26069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:06.804380 26078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:06.804414 26074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:06.804446 26075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:06.804646 26069 server_base.cc:1034] running on GCE node
I20260810 04:14:06.804809 26069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:06.804965 26069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:06.806137 26069 hybrid_clock.cc:648] HybridClock initialized: now 1786335246806124 us; error 26 us; skew 500 ppm
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:06.808490 26069 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:14:06.808820 26069 webserver.cc:460] Webserver started at http://127.10.249.131:41635/ using document root <none> and password file <none>
I20260810 04:14:06.808990 26069 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:06.809026 26069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:06.809101 26069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:06.810078 26069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "4004080187a94ccdbcd51dfff8e65345"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "8bbb70ae58a8479fcae649a8a2c9efc4"
server_key_iv: "684e9308678521f2386e7aa188d91378"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.810348 26069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "4004080187a94ccdbcd51dfff8e65345"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "8bbb70ae58a8479fcae649a8a2c9efc4"
server_key_iv: "684e9308678521f2386e7aa188d91378"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.811486 26069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:06.812104 26085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.812269 26069 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:06.812345 26069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "4004080187a94ccdbcd51dfff8e65345"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "8bbb70ae58a8479fcae649a8a2c9efc4"
server_key_iv: "684e9308678521f2386e7aa188d91378"
server_key_version: "encryptionkey@0"
I20260810 04:14:06.812391 26069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:06.825423 26069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:06.827301 26069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:06.827396 26069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:06.827538 26069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:06.827837 26069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:06.827868 26069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.827886 26069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:06.827932 26069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:06.833844 26069 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:38047
I20260810 04:14:06.833882 26208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:38047 every 8 connection(s)
I20260810 04:14:06.834195 26069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:14:06.837297 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 26069
I20260810 04:14:06.837379 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:14:06.837556 11238 external_mini_cluster.cc:1428] Setting key a1915a8472826db5e0cc638288e3c5ee
Aug 10 04:14:06 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335246, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:06.842562 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.834873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:40867 (local address 127.10.249.190:45857)
0810 04:14:06.834927 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:06.834929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:06.835113 (+ 184us) server_negotiation.cc:407] Connection header received
0810 04:14:06.835535 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:06.835536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:06.835557 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:06.835607 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:06.836414 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.836855 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.837919 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.838201 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.838268 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.840262 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:06.840264 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:06.840264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:06.840271 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:06.841433 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.841823 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.841824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.841825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.841889 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.842093 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.842094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.842094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.842189 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:06.842238 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:06.842443 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 04:14:06.842501 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:14:06.842785 26211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.834848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:40867)
0810 04:14:06.834998 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:06.835037 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:06.835462 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:06.835673 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:06.835676 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:06.836190 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:06.836349 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.836353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.836928 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.836929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.837841 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.837845 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.838288 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.838289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.838420 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.838884 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:06.838892 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:06.840181 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:06.841496 (+ 1315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:06.841502 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:06.841503 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:06.841719 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:06.841946 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:06.841947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:06.841947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:06.842038 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:06.842242 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:06.842246 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:06.842342 (+ 96us) client_negotiation.cc:769] Sending connection context
0810 04:14:06.842416 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:14:06.842520 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260810 04:14:06.843252 26209 heartbeater.cc:347] Connected to a master server at 127.10.249.190:45857
I20260810 04:14:06.843353 26209 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:06.843511 26209 heartbeater.cc:511] Master 127.10.249.190:45857 requested a full tablet report, sending...
I20260810 04:14:06.843876 25722 ts_manager.cc:194] Registered new tserver with Master: 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047)
I20260810 04:14:06.844256 25722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:40867
I20260810 04:14:06.849653 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:14:06.856226 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.851036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33052 (local address 127.10.249.190:45857)
0810 04:14:06.851078 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:06.851080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:06.851234 (+ 154us) server_negotiation.cc:407] Connection header received
0810 04:14:06.851311 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:06.851312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:06.851325 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:06.851406 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:06.851980 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.852416 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.853023 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.853208 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.853272 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.854387 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:06.854388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:06.854388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:06.854392 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:06.855407 (+ 1015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.855680 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.855681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.855682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.855726 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:06.855854 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:06.855855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:06.855855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:06.855962 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:06.856035 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:06.856106 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 04:14:06.856153 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:14:06.857692 25722 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:14:06.859125 25722 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:14:06.865309 26225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.861531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:35759 (local address 127.0.0.1:35174)
0810 04:14:06.861723 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:06.861729 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:06.861783 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:06.862091 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:06.862093 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:06.862095 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:06.862135 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.862136 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.863417 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.863417 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.864162 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.864164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.865016 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.865018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.865089 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.865101 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 04:14:06.865180 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 04:14:06.865237 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":60,"threads_started":1}
I20260810 04:14:06.865334 26226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.861744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.10.249.130:35759)
0810 04:14:06.861930 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:06.861935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:06.861944 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:06.861979 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:06.861981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:06.861995 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:06.862217 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:06.862308 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.863314 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.864254 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.864872 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.864936 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.864981 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:06.865191 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 04:14:06.865245 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":88,"threads_started":1}
I20260810 04:14:06.865485 26222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.861294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43202 (local address 127.10.249.131:38047)
0810 04:14:06.861452 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:06.861456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:06.861526 (+ 70us) server_negotiation.cc:407] Connection header received
0810 04:14:06.861669 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:06.861679 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:06.861696 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:06.861767 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:06.861995 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.863048 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.864535 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.865165 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.865226 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.865269 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:06.865400 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 04:14:06.865434 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":69,"threads_started":1}
I20260810 04:14:06.865713 26221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.861198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38047 (local address 127.0.0.1:43202)
0810 04:14:06.861437 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:06.861474 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:06.861561 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:06.861808 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:06.861811 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:06.861813 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:06.861871 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.861873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.863134 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.863135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.864456 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.864459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.865233 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.865234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.865290 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.865294 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:14:06.865612 (+ 318us) client_negotiation.cc:240] Negotiation successful
0810 04:14:06.865661 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":32,"thread_start_us":61,"threads_started":1}
I20260810 04:14:06.866389 26223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.861387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38093 (local address 127.0.0.1:56922)
0810 04:14:06.861504 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:06.861513 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:06.861565 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:06.862140 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:06.862141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:06.862143 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:06.862197 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.862199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.863064 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.863065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.864456 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:06.864459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.866140 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.866141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:06.866213 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.866217 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:14:06.866269 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 04:14:06.866304 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":91,"thread_start_us":63,"threads_started":1}
I20260810 04:14:06.866411 26224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:06.861511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56922 (local address 127.10.249.129:38093)
0810 04:14:06.861919 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:06.861923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:06.861932 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:06.861965 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:06.861986 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:06.862002 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:06.862066 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:06.862253 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.862962 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.865306 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:06.866073 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:06.866141 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:06.866188 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:06.866282 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 04:14:06.866318 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":75,"threads_started":1}
I20260810 04:14:06.866436 25994 tablet_service.cc:1467] Processing CreateTablet for tablet 94106f19093b42d5b7fb02179cf39aca (DEFAULT_TABLE table=test-table [id=673e457e655b4cb1a0e877671c28ed73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:06.866434 26136 tablet_service.cc:1467] Processing CreateTablet for tablet 94106f19093b42d5b7fb02179cf39aca (DEFAULT_TABLE table=test-table [id=673e457e655b4cb1a0e877671c28ed73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:06.866786 25994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94106f19093b42d5b7fb02179cf39aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:06.866786 26136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94106f19093b42d5b7fb02179cf39aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:06.867120 25852 tablet_service.cc:1467] Processing CreateTablet for tablet 94106f19093b42d5b7fb02179cf39aca (DEFAULT_TABLE table=test-table [id=673e457e655b4cb1a0e877671c28ed73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:06.867390 25852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94106f19093b42d5b7fb02179cf39aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:06.869541 26227 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Bootstrap starting.
I20260810 04:14:06.870275 26227 tablet_bootstrap.cc:654] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:06.870288 26228 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Bootstrap starting.
I20260810 04:14:06.870775 26227 log.cc:824] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:06.870863 26228 tablet_bootstrap.cc:654] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:06.871330 26228 log.cc:824] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:06.871551 26227 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: No bootstrap required, opened a new log
I20260810 04:14:06.871637 26227 ts_tablet_manager.cc:1397] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:14:06.871685 26229 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Bootstrap starting.
I20260810 04:14:06.872262 26229 tablet_bootstrap.cc:654] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:06.872738 26229 log.cc:824] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:06.873260 26228 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: No bootstrap required, opened a new log
I20260810 04:14:06.873338 26228 ts_tablet_manager.cc:1397] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 04:14:06.873365 26227 raft_consensus.cc:348] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:06.873538 26227 raft_consensus.cc:374] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:06.873588 26227 raft_consensus.cc:729] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb2d4e7de894f019a7ae290cc31c6e7, State: Initialized, Role: FOLLOWER
I20260810 04:14:06.873710 26227 consensus_queue.cc:260] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:06.874017 26227 ts_tablet_manager.cc:1428] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 04:14:06.874059 25921 heartbeater.cc:503] Master 127.10.249.190:45857 was elected leader, sending a full tablet report...
I20260810 04:14:06.875101 26228 raft_consensus.cc:348] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:06.875254 26228 raft_consensus.cc:374] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:06.875319 26228 raft_consensus.cc:729] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f294539b15214f77b0887f2d61b147d4, State: Initialized, Role: FOLLOWER
I20260810 04:14:06.875428 26228 consensus_queue.cc:260] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:06.875696 26228 ts_tablet_manager.cc:1428] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 04:14:06.875722 26064 heartbeater.cc:503] Master 127.10.249.190:45857 was elected leader, sending a full tablet report...
I20260810 04:14:06.876497 26229 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: No bootstrap required, opened a new log
I20260810 04:14:06.876587 26229 ts_tablet_manager.cc:1397] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 04:14:06.877969 26229 raft_consensus.cc:348] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:06.878096 26229 raft_consensus.cc:374] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:06.878140 26229 raft_consensus.cc:729] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4004080187a94ccdbcd51dfff8e65345, State: Initialized, Role: FOLLOWER
I20260810 04:14:06.878250 26229 consensus_queue.cc:260] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:06.878520 26229 ts_tablet_manager.cc:1428] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:14:06.878552 26209 heartbeater.cc:503] Master 127.10.249.190:45857 was elected leader, sending a full tablet report...
W20260810 04:14:06.902005 26065 tablet.cc:2369] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:14:06.993804 25922 tablet.cc:2369] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:14:07.084933 26210 tablet.cc:2369] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:14:07.142405 26235 raft_consensus.cc:482] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:14:07.142532 26235 raft_consensus.cc:504] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:07.142901 26235 leader_election.cc:288] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093), f294539b15214f77b0887f2d61b147d4 (127.10.249.130:35759)
I20260810 04:14:07.145614 26224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.143132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:49457 (local address 127.10.249.129:38093)
0810 04:14:07.143174 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.143176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.143189 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:14:07.143226 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.143227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.143236 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.143319 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:07.143536 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.144067 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.144949 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.145266 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.145314 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.145340 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.145487 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.145526 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:14:07.145618 26211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.143056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38093 (local address 127.10.249.131:49457)
0810 04:14:07.143113 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.143124 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.143167 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.143350 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.143351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.143353 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:07.143450 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.143452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.144162 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.144163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.144858 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.144860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.145339 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.145340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.145413 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.145416 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.145459 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.145505 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":9}
I20260810 04:14:07.145628 26226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.143239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:51489 (local address 127.10.249.130:35759)
0810 04:14:07.143333 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.143336 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.143428 (+ 92us) server_negotiation.cc:407] Connection header received
0810 04:14:07.143461 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.143462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.143471 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.143526 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:07.143668 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.144122 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.144981 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.145273 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.145350 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.145358 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.145524 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.145573 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 04:14:07.145633 26236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.143177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:35759 (local address 127.10.249.131:51489)
0810 04:14:07.143352 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.143362 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.143418 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.143529 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.143530 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.143531 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:07.143598 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.143599 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.144218 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.144219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.144881 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.144882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.145366 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.145367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.145437 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.145440 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.145504 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.145537 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":81,"threads_started":1}
I20260810 04:14:07.146000 26014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94106f19093b42d5b7fb02179cf39aca" candidate_uuid: "4004080187a94ccdbcd51dfff8e65345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f294539b15214f77b0887f2d61b147d4" is_pre_election: true
I20260810 04:14:07.146035 25873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94106f19093b42d5b7fb02179cf39aca" candidate_uuid: "4004080187a94ccdbcd51dfff8e65345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" is_pre_election: true
I20260810 04:14:07.146164 26014 raft_consensus.cc:2454] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4004080187a94ccdbcd51dfff8e65345 in term 0.
I20260810 04:14:07.146174 25873 raft_consensus.cc:2454] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4004080187a94ccdbcd51dfff8e65345 in term 0.
I20260810 04:14:07.146412 26088 leader_election.cc:302] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4004080187a94ccdbcd51dfff8e65345, 6bb2d4e7de894f019a7ae290cc31c6e7; no voters:
I20260810 04:14:07.146626 26235 raft_consensus.cc:2781] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:14:07.146690 26235 raft_consensus.cc:482] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:14:07.146715 26235 raft_consensus.cc:3037] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:07.147365 26235 raft_consensus.cc:504] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:07.147480 26235 leader_election.cc:288] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093), f294539b15214f77b0887f2d61b147d4 (127.10.249.130:35759)
I20260810 04:14:07.147641 26014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94106f19093b42d5b7fb02179cf39aca" candidate_uuid: "4004080187a94ccdbcd51dfff8e65345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f294539b15214f77b0887f2d61b147d4"
I20260810 04:14:07.147666 25873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94106f19093b42d5b7fb02179cf39aca" candidate_uuid: "4004080187a94ccdbcd51dfff8e65345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7"
I20260810 04:14:07.147732 26014 raft_consensus.cc:3037] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:07.147735 25873 raft_consensus.cc:3037] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:07.148396 26014 raft_consensus.cc:2454] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4004080187a94ccdbcd51dfff8e65345 in term 1.
I20260810 04:14:07.148445 25873 raft_consensus.cc:2454] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4004080187a94ccdbcd51dfff8e65345 in term 1.
I20260810 04:14:07.148600 26088 leader_election.cc:302] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4004080187a94ccdbcd51dfff8e65345, 6bb2d4e7de894f019a7ae290cc31c6e7; no voters:
I20260810 04:14:07.148692 26235 raft_consensus.cc:2781] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:14:07.148891 26235 raft_consensus.cc:686] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 1 LEADER]: Becoming Leader. State: Replica: 4004080187a94ccdbcd51dfff8e65345, State: Running, Role: LEADER
I20260810 04:14:07.148989 26235 consensus_queue.cc:237] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:07.149777 25722 catalog_manager.cc:5495] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131). New cstate: current_term: 1 leader_uuid: "4004080187a94ccdbcd51dfff8e65345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } health_report { overall_health: UNKNOWN } } }
I20260810 04:14:07.221432 26222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.218958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43208 (local address 127.10.249.131:38047)
0810 04:14:07.218999 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.219000 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.219009 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:07.219089 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.219090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.219112 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.219204 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:14:07.219327 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.219802 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.220649 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.220838 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.220885 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.221073 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:14:07.221165 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:14:07.221220 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.221289 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.221336 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:14:07.223286 25873 raft_consensus.cc:1261] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Refusing update from remote peer 4004080187a94ccdbcd51dfff8e65345: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:07.223286 26014 raft_consensus.cc:1261] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Refusing update from remote peer 4004080187a94ccdbcd51dfff8e65345: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:07.223645 26235 consensus_queue.cc:1035] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:07.223812 26237 consensus_queue.cc:1035] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:07.225893 26242 mvcc.cc:205] Tried to move back new op lower bound from 7316829172623515648 to 7316829172322820096. Current Snapshot: MvccSnapshot[applied={T|T < 7316829172623515648}]
I20260810 04:14:07.227916 25720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:14:07.228012 25720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:14:07.228660 25720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Sending DeleteTablet for 3 replicas of tablet 94106f19093b42d5b7fb02179cf39aca
I20260810 04:14:07.228956 26136 tablet_service.cc:1514] Processing DeleteTablet for tablet 94106f19093b42d5b7fb02179cf39aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:07 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:43202
I20260810 04:14:07.229017 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 25786
I20260810 04:14:07.229089 25852 tablet_service.cc:1514] Processing DeleteTablet for tablet 94106f19093b42d5b7fb02179cf39aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:07 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:56922
I20260810 04:14:07.229763 25994 tablet_service.cc:1514] Processing DeleteTablet for tablet 94106f19093b42d5b7fb02179cf39aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:07 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:35174
I20260810 04:14:07.230924 26253 tablet_replica.cc:330] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: stopping tablet replica
I20260810 04:14:07.231030 26253 raft_consensus.cc:2229] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:14:07.231129 26253 raft_consensus.cc:2258] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:07.231292 26252 tablet_replica.cc:330] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: stopping tablet replica
I20260810 04:14:07.231400 26252 raft_consensus.cc:2229] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:14:07.231490 26252 raft_consensus.cc:2258] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:07.231932 26252 ts_tablet_manager.cc:1905] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:14:07.233994 26252 ts_tablet_manager.cc:1918] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:07.234073 26252 log.cc:1196] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/94106f19093b42d5b7fb02179cf39aca
I20260810 04:14:07.234378 26252 ts_tablet_manager.cc:1939] T 94106f19093b42d5b7fb02179cf39aca P 4004080187a94ccdbcd51dfff8e65345: Deleting consensus metadata
I20260810 04:14:07.235221 25706 catalog_manager.cc:4841] TS 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047): tablet 94106f19093b42d5b7fb02179cf39aca (table test-table [id=673e457e655b4cb1a0e877671c28ed73]) successfully deleted
I20260810 04:14:07.235369 26253 ts_tablet_manager.cc:1905] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:14:07.236650 26253 ts_tablet_manager.cc:1918] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:07.236781 26253 log.cc:1196] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/94106f19093b42d5b7fb02179cf39aca
I20260810 04:14:07.237026 26253 ts_tablet_manager.cc:1939] T 94106f19093b42d5b7fb02179cf39aca P f294539b15214f77b0887f2d61b147d4: Deleting consensus metadata
I20260810 04:14:07.237448 25706 catalog_manager.cc:4841] TS f294539b15214f77b0887f2d61b147d4 (127.10.249.130:35759): tablet 94106f19093b42d5b7fb02179cf39aca (table test-table [id=673e457e655b4cb1a0e877671c28ed73]) successfully deleted
W20260810 04:14:07.238351 25706 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:38093 (error 108)
I20260810 04:14:07.238492 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 25926
I20260810 04:14:07.239516 26223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.238674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38093 (local address 127.0.0.1:56932)
0810 04:14:07.239442 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.239479 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:38093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":748}
W20260810 04:14:07.240304 25706 catalog_manager.cc:4584] TS 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 94106f19093b42d5b7fb02179cf39aca: Network error: Client connection negotiation failed: client connection to 127.10.249.129:38093: connect: Connection refused (error 111)
I20260810 04:14:07.243781 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 26069
I20260810 04:14:07.248442 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 25687
I20260810 04:14:07.253849 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:45857
--webserver_interface=127.10.249.190
--webserver_port=41515
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:45857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:07.327824 26255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:07.327989 26255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:07.328007 26255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:07.328979 26255 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:07.329020 26255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:07.329032 26255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:07.329067 26255 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:07.329095 26255 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:07.330320 26255 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:45857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:45857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=41515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:07.330536 26255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:07.330735 26255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:07.338898 26264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:07.338903 26261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:07.338938 26255 server_base.cc:1034] running on GCE node
W20260810 04:14:07.338903 26262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:07.339359 26255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:07.339622 26255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:07.340770 26255 hybrid_clock.cc:648] HybridClock initialized: now 1786335247340747 us; error 35 us; skew 500 ppm
Aug 10 04:14:07 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335247, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:07.343328 26255 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:14:07.343694 26255 webserver.cc:460] Webserver started at http://127.10.249.190:41515/ using document root <none> and password file <none>
I20260810 04:14:07.343873 26255 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:07.343930 26255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:07.345181 26255 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:07.345777 26273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.346004 26255 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:07.346110 26255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "daef6723510d47c587a2d59faa1cacd9"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "2b5f2ae093f5bcb73b2f606f37309d04"
server_key_iv: "d5b5a17ab4c2f8a1f2fc0ecc7f7c9d97"
server_key_version: "encryptionkey@0"
I20260810 04:14:07.346432 26255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:07.356005 26255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:07.357693 26255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:07.357864 26255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:07.361409 26255 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:45857
I20260810 04:14:07.361452 26332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:45857 every 8 connection(s)
I20260810 04:14:07.361768 26255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:14:07.363302 26333 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:14:07.363988 26333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Bootstrap starting.
I20260810 04:14:07.368335 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 26255
I20260810 04:14:07.368690 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:38093
--local_ip_for_outbound_sockets=127.10.249.129
--tserver_master_addrs=127.10.249.190:45857
--webserver_port=34851
--webserver_interface=127.10.249.129
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:07.372786 26333 log.cc:824] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:07.374784 26333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:14:07.375062 26333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Bootstrap complete.
I20260810 04:14:07.377067 26333 raft_consensus.cc:348] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:07.377260 26333 raft_consensus.cc:729] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: daef6723510d47c587a2d59faa1cacd9, State: Initialized, Role: FOLLOWER
I20260810 04:14:07.377408 26333 consensus_queue.cc:260] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:07.377461 26333 raft_consensus.cc:388] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:14:07.377518 26333 raft_consensus.cc:482] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:14:07.377557 26333 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:14:07.378499 26333 raft_consensus.cc:504] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:07.378578 26333 leader_election.cc:302] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daef6723510d47c587a2d59faa1cacd9; no voters:
I20260810 04:14:07.378774 26333 leader_election.cc:288] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 04:14:07.378805 26337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:14:07.378902 26337 raft_consensus.cc:686] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 2 LEADER]: Becoming Leader. State: Replica: daef6723510d47c587a2d59faa1cacd9, State: Running, Role: LEADER
I20260810 04:14:07.379016 26333 sys_catalog.cc:564] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:07.379038 26337 consensus_queue.cc:237] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:07.379473 26338 sys_catalog.cc:455] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "daef6723510d47c587a2d59faa1cacd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } } }
I20260810 04:14:07.379555 26338 sys_catalog.cc:458] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:07.379915 26344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:14:07.380410 26339 sys_catalog.cc:455] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daef6723510d47c587a2d59faa1cacd9. Latest consensus state: current_term: 2 leader_uuid: "daef6723510d47c587a2d59faa1cacd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } } }
I20260810 04:14:07.380510 26339 sys_catalog.cc:458] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:07.380692 26344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:14:07.380798 26344 catalog_manager.cc:1259] Loaded cluster ID: 601e3e195ccf4be6b9a7ebde9f3b711f
I20260810 04:14:07.380884 26344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:14:07.381327 26344 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 04:14:07.385282 26344 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 04:14:07.387426 26344 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:14:07.387601 26344 catalog_manager.cc:5879] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Loaded TSK: 0
I20260810 04:14:07.387802 26344 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:14:07.445490 26335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:07.445684 26335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:07.445719 26335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:07.446699 26335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:07.446758 26335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:07.446798 26335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:14:07.448046 26335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:38093
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=34851
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:07.448277 26335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:07.448478 26335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:07.453199 26363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:07.453254 26362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:07.453215 26365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:07.453616 26335 server_base.cc:1034] running on GCE node
I20260810 04:14:07.453858 26335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:07.454119 26335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:07.455287 26335 hybrid_clock.cc:648] HybridClock initialized: now 1786335247455280 us; error 29 us; skew 500 ppm
Aug 10 04:14:07 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335247, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:07.457722 26335 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:14:07.458248 26335 webserver.cc:460] Webserver started at http://127.10.249.129:34851/ using document root <none> and password file <none>
I20260810 04:14:07.458493 26335 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:07.458575 26335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:07.459920 26335 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:07.460619 26373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.460770 26335 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:07.460876 26335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "6bb2d4e7de894f019a7ae290cc31c6e7"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "e34c642f3f696fb16ad4abff3b40bb2c"
server_key_iv: "c750b99287890c13267a968ea6879136"
server_key_version: "encryptionkey@0"
I20260810 04:14:07.461193 26335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:07.477072 26335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:07.479071 26335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:07.479218 26335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:07.479487 26335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:07.479986 26380 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:14:07.481571 26335 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:14:07.481622 26335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 04:14:07.481660 26335 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:14:07.482378 26335 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:14:07.482421 26335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 04:14:07.482483 26380 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Bootstrap starting.
I20260810 04:14:07.489611 26335 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:38093
I20260810 04:14:07.490073 26335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:14:07.490605 26497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:38093 every 8 connection(s)
I20260810 04:14:07.493767 26380 log.cc:824] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:07.494139 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 26335
I20260810 04:14:07.494485 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:35759
--local_ip_for_outbound_sockets=127.10.249.130
--tserver_master_addrs=127.10.249.190:45857
--webserver_port=33181
--webserver_interface=127.10.249.130
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:07.496153 26380 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:14:07.496438 26380 tablet_bootstrap.cc:492] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Bootstrap complete.
I20260810 04:14:07.497543 26380 ts_tablet_manager.cc:1397] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.011s
Aug 10 04:14:07 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335247, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:07.498832 26380 raft_consensus.cc:348] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:07.499392 26380 raft_consensus.cc:729] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb2d4e7de894f019a7ae290cc31c6e7, State: Initialized, Role: FOLLOWER
I20260810 04:14:07.499585 26380 consensus_queue.cc:260] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } } peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } }
I20260810 04:14:07.499954 26380 ts_tablet_manager.cc:1428] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Time spent starting tablet: real 0.002s user 0.003s sys 0.003s
I20260810 04:14:07.502564 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.490807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:39593)
0810 04:14:07.491015 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.491059 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.491608 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.492169 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.492193 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.492513 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:07.492735 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.492741 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.494442 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.494443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.495523 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.495526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.496378 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.496379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.496519 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.497047 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:07.497056 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:07.498682 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:07.500709 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:07.500715 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:07.500717 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:07.500996 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:07.501303 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:07.501304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:07.501304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:07.501433 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:07.501945 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:07.501949 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:07.502076 (+ 127us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.502215 (+ 139us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.502382 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":106,"threads_started":1}
I20260810 04:14:07.503175 26502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.490913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:39593 (local address 127.10.249.190:45857)
0810 04:14:07.491083 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.491091 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.491139 (+ 48us) server_negotiation.cc:407] Connection header received
0810 04:14:07.491870 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.491877 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.491940 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.492116 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:07.492872 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.494310 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.495615 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.496173 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.496274 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.498784 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:07.498788 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:07.498789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:07.498799 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:07.500613 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.501099 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.501102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.501102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.501222 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.501515 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.501516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.501516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.501844 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:07.501962 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.502304 (+ 342us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.502465 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":72,"threads_started":1}
I20260810 04:14:07.503948 26498 heartbeater.cc:347] Connected to a master server at 127.10.249.190:45857
I20260810 04:14:07.504037 26498 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:07.504199 26498 heartbeater.cc:511] Master 127.10.249.190:45857 requested a full tablet report, sending...
I20260810 04:14:07.504943 26293 ts_manager.cc:194] Registered new tserver with Master: 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093)
I20260810 04:14:07.506007 26293 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:39593
I20260810 04:14:07.506875 26498 heartbeater.cc:503] Master 127.10.249.190:45857 was elected leader, sending a full tablet report...
Aug 10 04:14:07 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335247, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
I20260810 04:14:07.513093 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.505568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38093 (local address 127.0.0.1:56942)
0810 04:14:07.505913 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.505947 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.506027 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.506387 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.506392 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.506698 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:07.506747 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.506750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.507970 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.507971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.508438 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.508439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.508968 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.508968 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.509015 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.509448 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:07.509453 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:07.510659 (+ 1206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:07.512234 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:07.512240 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:07.512242 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:07.512405 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:07.512585 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:07.512586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:07.512586 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:07.512633 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:07.512876 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:07.512882 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:07.512916 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.512969 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.513040 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":95,"threads_started":1}
I20260810 04:14:07.513167 26507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.505737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56942 (local address 127.10.249.129:38093)
0810 04:14:07.505881 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.505885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.506021 (+ 136us) server_negotiation.cc:407] Connection header received
0810 04:14:07.506164 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.506167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.506186 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.506362 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:07.506836 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.507884 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.508509 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.508898 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.508963 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.510742 (+ 1779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:07.510748 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:07.510748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:07.510754 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:07.512162 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.512472 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.512475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.512475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.512528 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.512683 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.512683 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.512684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.512821 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:07.512890 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.513011 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.513091 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":91,"threads_started":1}
I20260810 04:14:07.513446 26424 tablet_service.cc:1514] Processing DeleteTablet for tablet 94106f19093b42d5b7fb02179cf39aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:07 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:56942
I20260810 04:14:07.514092 26508 tablet_replica.cc:330] stopping tablet replica
I20260810 04:14:07.514207 26508 raft_consensus.cc:2229] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:14:07.514297 26508 raft_consensus.cc:2258] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:07.514572 26508 ts_tablet_manager.cc:1905] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:14:07.516430 26508 ts_tablet_manager.cc:1918] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:07.516527 26508 log.cc:1196] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/94106f19093b42d5b7fb02179cf39aca
I20260810 04:14:07.516750 26508 ts_tablet_manager.cc:1939] T 94106f19093b42d5b7fb02179cf39aca P 6bb2d4e7de894f019a7ae290cc31c6e7: Deleting consensus metadata
I20260810 04:14:07.517169 26276 catalog_manager.cc:4841] TS 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093): tablet 94106f19093b42d5b7fb02179cf39aca (table test-table [id=673e457e655b4cb1a0e877671c28ed73]) successfully deleted
W20260810 04:14:07.575420 26504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:07.575583 26504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:07.575603 26504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:07.576625 26504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:07.576663 26504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:07.576686 26504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:14:07.577988 26504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:35759
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=33181
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:07.578197 26504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:07.578397 26504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:07.583200 26513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:07.583223 26514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:07.583200 26516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:07.583375 26504 server_base.cc:1034] running on GCE node
I20260810 04:14:07.583705 26504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:07.583950 26504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:07.585086 26504 hybrid_clock.cc:648] HybridClock initialized: now 1786335247585068 us; error 37 us; skew 500 ppm
Aug 10 04:14:07 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335247, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:07.587373 26504 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:14:07.587743 26504 webserver.cc:460] Webserver started at http://127.10.249.130:33181/ using document root <none> and password file <none>
I20260810 04:14:07.587953 26504 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:07.588027 26504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:07.589195 26504 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:07.589735 26524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.589895 26504 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.589977 26504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "f294539b15214f77b0887f2d61b147d4"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "72c3b572488391a0fec5884acf30bb8d"
server_key_iv: "9e012c6eb2b1514c757b117d525bbabc"
server_key_version: "encryptionkey@0"
I20260810 04:14:07.590266 26504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:07.605116 26504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:07.606889 26504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:07.607038 26504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:07.607240 26504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:07.607517 26504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:07.607564 26504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.607601 26504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:07.607625 26504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.613174 26504 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:35759
I20260810 04:14:07.613226 26647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:35759 every 8 connection(s)
I20260810 04:14:07.613600 26504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:14:07 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335247, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:07.622376 26502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.614378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:48727 (local address 127.10.249.190:45857)
0810 04:14:07.614464 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.614466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.614638 (+ 172us) server_negotiation.cc:407] Connection header received
0810 04:14:07.615100 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.615101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.615111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.615170 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:07.616136 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.616661 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.617598 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.617940 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.617992 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.620064 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:07.620065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:07.620066 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:07.620071 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:07.621197 (+ 1126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.621551 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.621552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.621552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.621599 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.621864 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.621865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.621865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.621961 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:07.622014 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.622253 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.622315 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 04:14:07.622491 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 26504
I20260810 04:14:07.622659 26651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.614338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:48727)
0810 04:14:07.614521 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.614557 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.615011 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.615236 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.615239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.615857 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:07.616052 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.616057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.616747 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.616748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.617531 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.617533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.618014 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.618015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.618123 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.618642 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:07.618650 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:07.619986 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:07.621267 (+ 1281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:07.621273 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:07.621275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:07.621481 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:07.621654 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:07.621655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:07.621655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:07.621747 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:07.622021 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:07.622025 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:07.622135 (+ 110us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.622225 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.622402 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
I20260810 04:14:07.622774 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:38047
--local_ip_for_outbound_sockets=127.10.249.131
--tserver_master_addrs=127.10.249.190:45857
--webserver_port=41635
--webserver_interface=127.10.249.131
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:07.623788 26648 heartbeater.cc:347] Connected to a master server at 127.10.249.190:45857
I20260810 04:14:07.623880 26648 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:07.624055 26648 heartbeater.cc:511] Master 127.10.249.190:45857 requested a full tablet report, sending...
I20260810 04:14:07.624663 26293 ts_manager.cc:194] Registered new tserver with Master: f294539b15214f77b0887f2d61b147d4 (127.10.249.130:35759)
I20260810 04:14:07.625135 26293 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:48727
W20260810 04:14:07.700277 26652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:07.700476 26652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:07.700511 26652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:07.701622 26652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:07.701683 26652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:07.701730 26652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:14:07.703181 26652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:38047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=41635
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:07.703457 26652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:07.703681 26652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:07.708547 26660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:07.708549 26659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:07.708550 26662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:07.708793 26652 server_base.cc:1034] running on GCE node
I20260810 04:14:07.708999 26652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:07.709241 26652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:07.710378 26652 hybrid_clock.cc:648] HybridClock initialized: now 1786335247710357 us; error 36 us; skew 500 ppm
Aug 10 04:14:07 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335247, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:07.712839 26652 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:14:07.713299 26652 webserver.cc:460] Webserver started at http://127.10.249.131:41635/ using document root <none> and password file <none>
I20260810 04:14:07.713516 26652 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:07.713596 26652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:07.714948 26652 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:07.715449 26669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.715626 26652 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:07.715718 26652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "4004080187a94ccdbcd51dfff8e65345"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "8bbb70ae58a8479fcae649a8a2c9efc4"
server_key_iv: "684e9308678521f2386e7aa188d91378"
server_key_version: "encryptionkey@0"
I20260810 04:14:07.716023 26652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:07.727747 26652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:07.729677 26652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:07.729768 26652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:07.729964 26652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:07.730212 26652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:07.730240 26652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.730257 26652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:07.730268 26652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.735653 26652 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:38047
I20260810 04:14:07.735694 26786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:38047 every 8 connection(s)
I20260810 04:14:07.736013 26652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:14:07.738821 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 26652
Aug 10 04:14:07 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335247, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:07.744666 26502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.736619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:40405 (local address 127.10.249.190:45857)
0810 04:14:07.736681 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.736683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.736844 (+ 161us) server_negotiation.cc:407] Connection header received
0810 04:14:07.737243 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.737244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.737253 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.737307 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:07.738129 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.738581 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.739698 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.740059 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.740121 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.742059 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:07.742060 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:07.742060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:07.742067 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:07.743327 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.743712 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.743713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.743713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.743782 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.744046 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.744046 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.744047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.744154 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:07.744231 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.744510 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.744581 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:14:07.744845 26789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.736608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:40405)
0810 04:14:07.736740 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.736775 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.737176 (+ 401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.737351 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.737353 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.737900 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:07.738063 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.738067 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.738651 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.738652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.739625 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.739627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.740135 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.740136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.740273 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.740697 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:07.740707 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:07.741976 (+ 1269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:07.743409 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:07.743416 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:07.743418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:07.743635 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:07.743854 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:07.743855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:07.743855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:07.743964 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:07.744235 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:07.744241 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:07.744368 (+ 127us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.744475 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.744630 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":74,"threads_started":1}
I20260810 04:14:07.745287 26787 heartbeater.cc:347] Connected to a master server at 127.10.249.190:45857
I20260810 04:14:07.745378 26787 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:07.745546 26787 heartbeater.cc:511] Master 127.10.249.190:45857 requested a full tablet report, sending...
I20260810 04:14:07.745721 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.739191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33062 (local address 127.10.249.190:45857)
0810 04:14:07.739290 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.739291 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.739323 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:14:07.739388 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.739389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.739400 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.739451 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:07.740069 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.740798 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.741487 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.741698 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.741752 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.743016 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:07.743017 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:07.743017 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:07.743023 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:07.744489 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.744850 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.744851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.744851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.745058 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:07.745224 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:07.745225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:07.745225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:07.745353 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:07.745504 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.745555 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.745631 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":56,"threads_started":1}
I20260810 04:14:07.745960 26292 ts_manager.cc:194] Registered new tserver with Master: 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047)
I20260810 04:14:07.746333 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:14:07.746345 26292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:40405
I20260810 04:14:07.748739 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.746682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33070 (local address 127.10.249.190:45857)
0810 04:14:07.746737 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.746739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.746880 (+ 141us) server_negotiation.cc:407] Connection header received
0810 04:14:07.746924 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.746925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.746959 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.747021 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:14:07.747091 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.747509 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.748165 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.748325 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.748366 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.748505 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:14:07.748595 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:14:07.748677 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.748688 (+ 11us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.748703 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:14:07.748965 26292 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:14:07.750574 26292 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:14:07.752789 26424 tablet_service.cc:1467] Processing CreateTablet for tablet afe6647527b241cda80f8d8cd02f1c55 (DEFAULT_TABLE table=test-table [id=46149cc506024e609977dbc49c667c74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:07.752995 26424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe6647527b241cda80f8d8cd02f1c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:07.754587 26380 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Bootstrap starting.
I20260810 04:14:07.754902 26380 tablet_bootstrap.cc:654] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:07.755681 26380 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: No bootstrap required, opened a new log
I20260810 04:14:07.755743 26380 ts_tablet_manager.cc:1397] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:14:07.755888 26380 raft_consensus.cc:348] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.755960 26380 raft_consensus.cc:374] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:07.756006 26380 raft_consensus.cc:729] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb2d4e7de894f019a7ae290cc31c6e7, State: Initialized, Role: FOLLOWER
I20260810 04:14:07.756021 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.752339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38047 (local address 127.0.0.1:43218)
0810 04:14:07.752449 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.752457 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.752493 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.752971 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.752972 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.752973 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:07.753003 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.753004 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.754208 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.754209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.755189 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.755192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.755798 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.755799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.755853 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.755872 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.755925 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.755959 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":77,"threads_started":1}
I20260810 04:14:07.756039 26795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.752577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43218 (local address 127.10.249.131:38047)
0810 04:14:07.752726 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.752730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.752737 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:14:07.752770 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.752772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.752784 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.752859 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:07.753126 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.754095 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.755270 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.755717 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.755798 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.755845 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.755937 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.755969 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":70,"threads_started":1}
I20260810 04:14:07.756048 26380 consensus_queue.cc:260] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.756146 26380 ts_tablet_manager.cc:1428] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:07.756661 26719 tablet_service.cc:1467] Processing CreateTablet for tablet afe6647527b241cda80f8d8cd02f1c55 (DEFAULT_TABLE table=test-table [id=46149cc506024e609977dbc49c667c74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:07.756968 26719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe6647527b241cda80f8d8cd02f1c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:07.758496 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.752353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35178 (local address 127.10.249.130:35759)
0810 04:14:07.752504 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.752525 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.752534 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:07.752572 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.752574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.752590 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.752815 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:07.752907 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.753925 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.755404 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.758199 (+ 2795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.758251 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.758278 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.758418 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.758445 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260810 04:14:07.758509 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.752256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:35759 (local address 127.0.0.1:35178)
0810 04:14:07.752282 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.752292 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.752323 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.752703 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.752704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.752706 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:07.752755 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.752756 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.754022 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.754024 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.754853 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.754856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.758274 (+ 3418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.758275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.758342 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.758345 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.758408 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.758452 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260810 04:14:07.759090 26575 tablet_service.cc:1467] Processing CreateTablet for tablet afe6647527b241cda80f8d8cd02f1c55 (DEFAULT_TABLE table=test-table [id=46149cc506024e609977dbc49c667c74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:07.759352 26575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe6647527b241cda80f8d8cd02f1c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:07.759708 26798 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Bootstrap starting.
I20260810 04:14:07.760308 26798 tablet_bootstrap.cc:654] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:07.760772 26798 log.cc:824] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:07.761389 26798 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: No bootstrap required, opened a new log
I20260810 04:14:07.761438 26798 ts_tablet_manager.cc:1397] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:14:07.762154 26800 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Bootstrap starting.
I20260810 04:14:07.762732 26800 tablet_bootstrap.cc:654] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:07.763118 26798 raft_consensus.cc:348] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.763226 26800 log.cc:824] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:07.763273 26798 raft_consensus.cc:374] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:07.763305 26798 raft_consensus.cc:729] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4004080187a94ccdbcd51dfff8e65345, State: Initialized, Role: FOLLOWER
I20260810 04:14:07.763441 26798 consensus_queue.cc:260] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.763761 26798 ts_tablet_manager.cc:1428] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:14:07.763823 26787 heartbeater.cc:503] Master 127.10.249.190:45857 was elected leader, sending a full tablet report...
I20260810 04:14:07.764356 26800 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: No bootstrap required, opened a new log
I20260810 04:14:07.764427 26800 ts_tablet_manager.cc:1397] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:14:07.765635 26800 raft_consensus.cc:348] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.765751 26800 raft_consensus.cc:374] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:07.765769 26800 raft_consensus.cc:729] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f294539b15214f77b0887f2d61b147d4, State: Initialized, Role: FOLLOWER
I20260810 04:14:07.765914 26800 consensus_queue.cc:260] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.766165 26800 ts_tablet_manager.cc:1428] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:14:07.766179 26648 heartbeater.cc:503] Master 127.10.249.190:45857 was elected leader, sending a full tablet report...
W20260810 04:14:07.864173 26649 tablet.cc:2369] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:14:07.958822 26505 raft_consensus.cc:482] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:14:07.958984 26505 raft_consensus.cc:504] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.959352 26505 leader_election.cc:288] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f294539b15214f77b0887f2d61b147d4 (127.10.249.130:35759), 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047)
I20260810 04:14:07.962180 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.959519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:35759 (local address 127.10.249.129:56345)
0810 04:14:07.959570 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.959582 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.959632 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.959877 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.959878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.959880 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:07.959941 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.959942 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.960568 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.960569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.961315 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.961317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.961916 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.961917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.961994 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.962016 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.962077 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.962115 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 04:14:07.962182 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.959595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:56345 (local address 127.10.249.130:35759)
0810 04:14:07.959682 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.959684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.959693 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:07.959722 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.959723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.959732 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.959819 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:07.960014 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.960481 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.961405 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.961771 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.961916 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.961926 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.962083 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.962120 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 04:14:07.962417 26795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.959739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:53461 (local address 127.10.249.131:38047)
0810 04:14:07.959824 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.959826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.959865 (+ 39us) server_negotiation.cc:407] Connection header received
0810 04:14:07.959938 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.959938 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.959947 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.960017 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:07.960194 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.960719 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.961607 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.962052 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.962133 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.962141 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.962311 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.962357 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:14:07.962493 26598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe6647527b241cda80f8d8cd02f1c55" candidate_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f294539b15214f77b0887f2d61b147d4" is_pre_election: true
I20260810 04:14:07.962616 26805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.959626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38047 (local address 127.10.249.129:53461)
0810 04:14:07.959809 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.959819 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:07.959877 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:07.960021 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:07.960022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:07.960023 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:07.960111 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.960113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.960796 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.960797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.961510 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:07.961512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.962157 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.962158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:07.962212 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.962215 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:14:07.962504 (+ 289us) client_negotiation.cc:240] Negotiation successful
0810 04:14:07.962542 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":103,"threads_started":1}
I20260810 04:14:07.962664 26598 raft_consensus.cc:2454] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb2d4e7de894f019a7ae290cc31c6e7 in term 0.
I20260810 04:14:07.962886 26376 leader_election.cc:302] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb2d4e7de894f019a7ae290cc31c6e7, f294539b15214f77b0887f2d61b147d4; no voters:
I20260810 04:14:07.962934 26740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe6647527b241cda80f8d8cd02f1c55" candidate_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4004080187a94ccdbcd51dfff8e65345" is_pre_election: true
I20260810 04:14:07.963034 26505 raft_consensus.cc:2781] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:14:07.963081 26505 raft_consensus.cc:482] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:14:07.963069 26740 raft_consensus.cc:2454] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb2d4e7de894f019a7ae290cc31c6e7 in term 0.
I20260810 04:14:07.963107 26505 raft_consensus.cc:3037] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:07.963842 26505 raft_consensus.cc:504] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.963972 26505 leader_election.cc:288] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [CANDIDATE]: Term 1 election: Requested vote from peers f294539b15214f77b0887f2d61b147d4 (127.10.249.130:35759), 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047)
I20260810 04:14:07.964161 26598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe6647527b241cda80f8d8cd02f1c55" candidate_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f294539b15214f77b0887f2d61b147d4"
I20260810 04:14:07.964175 26740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe6647527b241cda80f8d8cd02f1c55" candidate_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4004080187a94ccdbcd51dfff8e65345"
I20260810 04:14:07.964246 26598 raft_consensus.cc:3037] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:07.964267 26740 raft_consensus.cc:3037] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:07.964958 26598 raft_consensus.cc:2454] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb2d4e7de894f019a7ae290cc31c6e7 in term 1.
I20260810 04:14:07.965111 26376 leader_election.cc:302] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb2d4e7de894f019a7ae290cc31c6e7, f294539b15214f77b0887f2d61b147d4; no voters:
I20260810 04:14:07.965139 26740 raft_consensus.cc:2454] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb2d4e7de894f019a7ae290cc31c6e7 in term 1.
I20260810 04:14:07.965204 26505 raft_consensus.cc:2781] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:14:07.965307 26505 raft_consensus.cc:686] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb2d4e7de894f019a7ae290cc31c6e7, State: Running, Role: LEADER
I20260810 04:14:07.965378 26505 consensus_queue.cc:237] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:07.966210 26292 catalog_manager.cc:5495] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129). New cstate: current_term: 1 leader_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } health_report { overall_health: HEALTHY } } }
I20260810 04:14:07.982708 26507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.980572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56956 (local address 127.10.249.129:38093)
0810 04:14:07.980610 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:07.980612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:07.980622 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:14:07.980692 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:07.980693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:07.980709 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:07.980767 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:14:07.980873 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.981323 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.982077 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:07.982287 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:07.982337 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:07.982456 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:14:07.982547 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:14:07.982597 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:07.982634 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 04:14:07.982657 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:14:07.984251 26740 raft_consensus.cc:1261] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 1 FOLLOWER]: Refusing update from remote peer 6bb2d4e7de894f019a7ae290cc31c6e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:07.984251 26598 raft_consensus.cc:1261] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Refusing update from remote peer 6bb2d4e7de894f019a7ae290cc31c6e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:07.984639 26505 consensus_queue.cc:1035] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:07.984793 26806 consensus_queue.cc:1035] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 04:14:07.986466 26788 tablet.cc:2369] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:14:07.987636 26812 mvcc.cc:205] Tried to move back new op lower bound from 7316829175740760064 to 7316829175666679808. Current Snapshot: MvccSnapshot[applied={T|T < 7316829175740760064 or (T in {7316829175740760064})}]
I20260810 04:14:07.989018 26293 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:14:07.989094 26293 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:14:07.989719 26293 catalog_manager.cc:5782] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Sending DeleteTablet for 3 replicas of tablet afe6647527b241cda80f8d8cd02f1c55
I20260810 04:14:07.990026 26575 tablet_service.cc:1514] Processing DeleteTablet for tablet afe6647527b241cda80f8d8cd02f1c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:07 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:35178
I20260810 04:14:07.990093 26424 tablet_service.cc:1514] Processing DeleteTablet for tablet afe6647527b241cda80f8d8cd02f1c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:07 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:56942
I20260810 04:14:07.990123 26719 tablet_service.cc:1514] Processing DeleteTablet for tablet afe6647527b241cda80f8d8cd02f1c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:07 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:43218
I20260810 04:14:07.990175 26508 tablet_replica.cc:330] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: stopping tablet replica
I20260810 04:14:07.990228 26508 raft_consensus.cc:2229] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:14:07.990293 26508 raft_consensus.cc:2258] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:07.990329 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 26335
W20260810 04:14:07.997859 26276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:38093 (error 108)
I20260810 04:14:07.997978 26820 tablet_replica.cc:330] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: stopping tablet replica
I20260810 04:14:07.998075 26820 raft_consensus.cc:2229] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:14:07.998178 26820 raft_consensus.cc:2258] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:07.998210 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 26504
I20260810 04:14:07.998307 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:07.998176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38093 (local address 127.0.0.1:56964)
0810 04:14:07.998241 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:07.998273 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:38093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 04:14:07.998315 26821 tablet_replica.cc:330] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: stopping tablet replica
I20260810 04:14:07.998478 26821 raft_consensus.cc:2229] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:14:07.998603 26821 raft_consensus.cc:2258] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 04:14:07.998401 26276 catalog_manager.cc:4584] TS 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet afe6647527b241cda80f8d8cd02f1c55: Network error: Client connection negotiation failed: client connection to 127.10.249.129:38093: connect: Connection refused (error 111)
I20260810 04:14:07.999300 26821 ts_tablet_manager.cc:1905] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:14:08.001300 26821 ts_tablet_manager.cc:1918] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:08.001382 26821 log.cc:1196] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/afe6647527b241cda80f8d8cd02f1c55
I20260810 04:14:08.001689 26821 ts_tablet_manager.cc:1939] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Deleting consensus metadata
I20260810 04:14:08.002207 26276 catalog_manager.cc:4841] TS 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047): tablet afe6647527b241cda80f8d8cd02f1c55 (table test-table [id=46149cc506024e609977dbc49c667c74]) successfully deleted
I20260810 04:14:08.005568 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 26652
I20260810 04:14:08.006392 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.005564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:35759 (local address 127.0.0.1:35192)
0810 04:14:08.005648 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.005680 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.130:35759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 04:14:08.012025 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 26255
I20260810 04:14:08.018110 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:45857
--webserver_interface=127.10.249.190
--webserver_port=41515
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:45857
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:08.091917 26823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:08.092147 26823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:08.092180 26823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:08.093217 26823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:08.093282 26823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:08.093303 26823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:08.093343 26823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:08.093369 26823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:08.094808 26823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:45857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:45857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=41515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:08.095052 26823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:08.095264 26823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:08.099606 26828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:08.099617 26831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:08.099619 26829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:08.099802 26823 server_base.cc:1034] running on GCE node
I20260810 04:14:08.100129 26823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:08.100430 26823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:08.101615 26823 hybrid_clock.cc:648] HybridClock initialized: now 1786335248101604 us; error 39 us; skew 500 ppm
Aug 10 04:14:08 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335248, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:08.103801 26823 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:14:08.104272 26823 webserver.cc:460] Webserver started at http://127.10.249.190:41515/ using document root <none> and password file <none>
I20260810 04:14:08.104506 26823 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:08.104584 26823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:08.105733 26823 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:14:08.106451 26840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:08.106614 26823 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:14:08.106709 26823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "daef6723510d47c587a2d59faa1cacd9"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "2b5f2ae093f5bcb73b2f606f37309d04"
server_key_iv: "d5b5a17ab4c2f8a1f2fc0ecc7f7c9d97"
server_key_version: "encryptionkey@0"
I20260810 04:14:08.106963 26823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:08.119350 26823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:08.121034 26823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:08.121201 26823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:08.126510 26823 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:45857
I20260810 04:14:08.126542 26894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:45857 every 8 connection(s)
I20260810 04:14:08.126883 26823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:14:08.128264 26895 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:14:08.128811 26895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Bootstrap starting.
I20260810 04:14:08.132892 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 26823
I20260810 04:14:08.133147 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:38093
--local_ip_for_outbound_sockets=127.10.249.129
--tserver_master_addrs=127.10.249.190:45857
--webserver_port=34851
--webserver_interface=127.10.249.129
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:08.136727 26895 log.cc:824] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:08.138717 26895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:14:08.139004 26895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9: Bootstrap complete.
I20260810 04:14:08.141114 26895 raft_consensus.cc:348] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:08.141301 26895 raft_consensus.cc:729] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: daef6723510d47c587a2d59faa1cacd9, State: Initialized, Role: FOLLOWER
I20260810 04:14:08.141444 26895 consensus_queue.cc:260] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:08.141494 26895 raft_consensus.cc:388] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:14:08.141541 26895 raft_consensus.cc:482] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:14:08.141594 26895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 2 FOLLOWER]: Advancing to term 3
I20260810 04:14:08.142558 26895 raft_consensus.cc:504] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:08.142639 26895 leader_election.cc:302] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daef6723510d47c587a2d59faa1cacd9; no voters:
I20260810 04:14:08.142822 26895 leader_election.cc:288] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 04:14:08.142866 26899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 04:14:08.142973 26899 raft_consensus.cc:686] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [term 3 LEADER]: Becoming Leader. State: Replica: daef6723510d47c587a2d59faa1cacd9, State: Running, Role: LEADER
I20260810 04:14:08.143049 26895 sys_catalog.cc:564] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:08.143054 26899 consensus_queue.cc:237] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } }
I20260810 04:14:08.143301 26899 sys_catalog.cc:455] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daef6723510d47c587a2d59faa1cacd9. Latest consensus state: current_term: 3 leader_uuid: "daef6723510d47c587a2d59faa1cacd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } } }
I20260810 04:14:08.143396 26899 sys_catalog.cc:458] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:08.143740 26901 sys_catalog.cc:455] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "daef6723510d47c587a2d59faa1cacd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daef6723510d47c587a2d59faa1cacd9" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 45857 } } }
I20260810 04:14:08.143867 26901 sys_catalog.cc:458] T 00000000000000000000000000000000 P daef6723510d47c587a2d59faa1cacd9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:08.144093 26903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:14:08.144925 26903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:14:08.145038 26903 catalog_manager.cc:1259] Loaded cluster ID: 601e3e195ccf4be6b9a7ebde9f3b711f
I20260810 04:14:08.145228 26903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 04:14:08.145467 26903 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2b4c8629ad google::LogMessage::Fail() at ??:0
@ 0x7f2b4c86588a google::LogMessage::SendToLog() at ??:0
@ 0x7f2b4c8624de google::LogMessage::Flush() at ??:0
@ 0x7f2b4c863a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2b547870f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f2b547908b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2b4e7300d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2b4e725954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2b4f5896db start_thread at ??:0
@ 0x7f2b4b36061f clone at ??:0
W20260810 04:14:08.222708 26897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:08.222909 26897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:08.222945 26897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:08.224058 26897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:08.224135 26897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:08.224184 26897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:14:08.225594 26897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:38093
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=34851
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:08.225871 26897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:08.226086 26897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:08.232138 26937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:08.232148 26936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:08.232404 26897 server_base.cc:1034] running on GCE node
W20260810 04:14:08.232427 26939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:08.232715 26897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:08.232981 26897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:08.234160 26897 hybrid_clock.cc:648] HybridClock initialized: now 1786335248234149 us; error 32 us; skew 500 ppm
Aug 10 04:14:08 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335248, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:08.236871 26897 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:14:08.237287 26897 webserver.cc:460] Webserver started at http://127.10.249.129:34851/ using document root <none> and password file <none>
I20260810 04:14:08.237514 26897 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:08.237581 26897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:08.238976 26897 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:08.239676 26946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:08.239874 26897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:08.239980 26897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "6bb2d4e7de894f019a7ae290cc31c6e7"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "e34c642f3f696fb16ad4abff3b40bb2c"
server_key_iv: "c750b99287890c13267a968ea6879136"
server_key_version: "encryptionkey@0"
I20260810 04:14:08.240331 26897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:08.259188 26897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:08.261133 26897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:08.261279 26897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:08.261480 26897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:08.261876 26953 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:14:08.263603 26897 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:14:08.263717 26897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 04:14:08.263808 26897 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:14:08.264432 26897 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:14:08.264487 26897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 04:14:08.264581 26953 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Bootstrap starting.
I20260810 04:14:08.271476 26897 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:38093
I20260810 04:14:08.271809 26897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:14:08.273952 27069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:38093 every 8 connection(s)
I20260810 04:14:08.274977 26953 log.cc:824] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:08.277447 26953 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:14:08.277731 26953 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Bootstrap complete.
I20260810 04:14:08.278566 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 26897
I20260810 04:14:08.278788 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:35759
--local_ip_for_outbound_sockets=127.10.249.130
--tserver_master_addrs=127.10.249.190:45857
--webserver_port=33181
--webserver_interface=127.10.249.130
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:08.278797 26953 ts_tablet_manager.cc:1397] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20260810 04:14:08.280035 26953 raft_consensus.cc:348] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:08.280361 26953 raft_consensus.cc:729] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb2d4e7de894f019a7ae290cc31c6e7, State: Initialized, Role: FOLLOWER
I20260810 04:14:08.280573 26953 consensus_queue.cc:260] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:08.280879 26953 ts_tablet_manager.cc:1428] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260810 04:14:08.318966 27072 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:14:08.272441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:51877)
0810 04:14:08.272598 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.272634 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:08.272991 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:08.318780 (+ 45789us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":100,"threads_started":1}
W20260810 04:14:08.319231 27070 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:45857 (0 consecutive failures): Network error: Failed to ping master at 127.10.249.190:45857: Client connection negotiation failed: client connection to 127.10.249.190:45857: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 04:14:08.319562 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.319446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:42223)
0810 04:14:08.319500 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.319535 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 04:14:08.319896 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.319794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:35469)
0810 04:14:08.319854 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.319877 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 04:14:08.320070 27070 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:14:08.356814 27074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:08.357009 27074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:08.357029 27074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:08.357981 27074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:08.358017 27074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:08.358039 27074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:14:08.359246 27074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:35759
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=33181
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:08.359416 27074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:08.359583 27074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:08.365127 27080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:08.365180 27081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:08.365191 27083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:08.365309 27074 server_base.cc:1034] running on GCE node
I20260810 04:14:08.365600 27074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:08.365890 27074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:08.367062 27074 hybrid_clock.cc:648] HybridClock initialized: now 1786335248367028 us; error 48 us; skew 500 ppm
Aug 10 04:14:08 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335248, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:08.369323 27074 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:14:08.369745 27074 webserver.cc:460] Webserver started at http://127.10.249.130:33181/ using document root <none> and password file <none>
I20260810 04:14:08.370005 27074 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:08.370077 27074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:08.371450 27074 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:08.372092 27091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:08.372256 27074 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:08.372354 27074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "f294539b15214f77b0887f2d61b147d4"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "72c3b572488391a0fec5884acf30bb8d"
server_key_iv: "9e012c6eb2b1514c757b117d525bbabc"
server_key_version: "encryptionkey@0"
I20260810 04:14:08.372673 27074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:08.383046 27074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:08.384899 27074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:08.385056 27074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:08.385289 27074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:08.385707 27098 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:14:08.387154 27074 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:14:08.387212 27074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 04:14:08.387259 27074 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:14:08.387884 27074 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:14:08.387938 27074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 04:14:08.387996 27098 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Bootstrap starting.
I20260810 04:14:08.394556 27074 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:35759
I20260810 04:14:08.394625 27215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:35759 every 8 connection(s)
I20260810 04:14:08.394938 27074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:14:08.395992 27218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.395494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:37397)
0810 04:14:08.395694 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.395788 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":66,"threads_started":1}
W20260810 04:14:08.396193 27216 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:45857 (0 consecutive failures): Network error: Failed to ping master at 127.10.249.190:45857: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
I20260810 04:14:08.396474 27218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.396359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:40047)
0810 04:14:08.396408 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.396442 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 04:14:08.396773 27218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.396685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:39551)
0810 04:14:08.396713 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.396742 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260810 04:14:08.396893 27216 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 04:14:08.398731 27098 log.cc:824] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:08.400627 27098 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:14:08.400910 27098 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Bootstrap complete.
I20260810 04:14:08.402004 27098 ts_tablet_manager.cc:1397] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.006s
I20260810 04:14:08.403074 27098 raft_consensus.cc:348] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:08.403312 27098 raft_consensus.cc:729] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f294539b15214f77b0887f2d61b147d4, State: Initialized, Role: FOLLOWER
I20260810 04:14:08.403504 27098 consensus_queue.cc:260] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:08.403759 27098 ts_tablet_manager.cc:1428] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 04:14:08.403976 27218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.403907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:59569)
0810 04:14:08.403933 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.403960 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
I20260810 04:14:08.404270 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 27074
I20260810 04:14:08.404311 27218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.404212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:33931)
0810 04:14:08.404261 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.404290 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 04:14:08.404543 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:38047
--local_ip_for_outbound_sockets=127.10.249.131
--tserver_master_addrs=127.10.249.190:45857
--webserver_port=41635
--webserver_interface=127.10.249.131
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:08.481889 27221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:08.482062 27221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:08.482084 27221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:08.483026 27221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:08.483055 27221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:08.483078 27221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:14:08.484462 27221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:38047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=41635
--tserver_master_addrs=127.10.249.190:45857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:08.484663 27221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:08.484825 27221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:08.489065 27227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:08.489076 27226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:08.489076 27229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:08.489297 27221 server_base.cc:1034] running on GCE node
I20260810 04:14:08.489470 27221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:08.489656 27221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:08.490803 27221 hybrid_clock.cc:648] HybridClock initialized: now 1786335248490787 us; error 30 us; skew 500 ppm
Aug 10 04:14:08 dist-test-slave-0kls krb5kdc[25673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335248, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:08.493151 27221 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:14:08.493585 27221 webserver.cc:460] Webserver started at http://127.10.249.131:41635/ using document root <none> and password file <none>
I20260810 04:14:08.493772 27221 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:08.493891 27221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:08.495087 27221 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:14:08.495618 27236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:08.495779 27221 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:14:08.495873 27221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "4004080187a94ccdbcd51dfff8e65345"
format_stamp: "Formatted at 2026-08-10 04:14:06 on dist-test-slave-0kls"
server_key: "8bbb70ae58a8479fcae649a8a2c9efc4"
server_key_iv: "684e9308678521f2386e7aa188d91378"
server_key_version: "encryptionkey@0"
I20260810 04:14:08.496147 27221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:08.519538 27221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:08.521242 27221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:08.521394 27221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:08.521582 27221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:08.521955 27221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:08.522017 27221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:08.522058 27221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:08.522085 27221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:08.527601 27221 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:38047
I20260810 04:14:08.527640 27358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:38047 every 8 connection(s)
I20260810 04:14:08.527948 27221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:14:08.528869 27361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.528544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:44357)
0810 04:14:08.528679 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.528747 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
W20260810 04:14:08.529268 27359 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:45857 (0 consecutive failures): Network error: Failed to ping master at 127.10.249.190:45857: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
I20260810 04:14:08.529582 27361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.529458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:53053)
0810 04:14:08.529523 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.529554 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 04:14:08.529664 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 27221
I20260810 04:14:08.529932 27361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:08.529848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:52305)
0810 04:14:08.529894 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:08.529916 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:14:08.530032 27359 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 04:14:09.320621 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:09.320410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:45403)
0810 04:14:09.320524 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:09.320558 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":63,"threads_started":1}
I20260810 04:14:09.404819 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:09.404636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:58325)
0810 04:14:09.404751 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:09.404778 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260810 04:14:09.530505 27365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:09.530303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:36823)
0810 04:14:09.530430 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:09.530460 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":76,"threads_started":1}
I20260810 04:14:09.714118 27366 raft_consensus.cc:482] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:14:09.714252 27366 raft_consensus.cc:504] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:09.714589 27366 leader_election.cc:288] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047), 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093)
Aug 10 04:14:09 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335248, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.129@KRBTEST.COM
Aug 10 04:14:09 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335248, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.131@KRBTEST.COM
I20260810 04:14:09.725402 27367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:09.714873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:34879 (local address 127.10.249.131:38047)
0810 04:14:09.715052 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:09.715063 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:09.715099 (+ 36us) server_negotiation.cc:407] Connection header received
0810 04:14:09.715813 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:09.715816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:09.715854 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:09.715953 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:09.716252 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:09.717483 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:09.718773 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:09.719180 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:09.719317 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:09.722109 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:09.722113 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:09.722113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:09.722125 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:09.723954 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:09.724287 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:09.724290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:09.724291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:09.724385 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:09.724593 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:09.724594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:09.724594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:09.724847 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:09.724952 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:09.725166 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 04:14:09.725283 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":59,"threads_started":1}
I20260810 04:14:09.725391 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:09.714761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38047 (local address 127.10.249.130:34879)
0810 04:14:09.714829 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:09.714859 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:09.715057 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:09.715964 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:09.715965 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:09.716116 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:09.716162 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:09.716164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:09.717629 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:09.717630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:09.718662 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:09.718666 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:09.719283 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:09.719284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:09.719391 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:09.719997 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:09.720016 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:09.721990 (+ 1974us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:09.724035 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:09.724036 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:09.724037 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:09.724204 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:09.724462 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:09.724462 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:09.724463 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:09.724528 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:09.724947 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:09.724948 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:09.725009 (+ 61us) client_negotiation.cc:769] Sending connection context
0810 04:14:09.725103 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 04:14:09.725297 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":59}
I20260810 04:14:09.725421 27369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:09.715003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:48675 (local address 127.10.249.129:38093)
0810 04:14:09.715169 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:09.715186 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:09.715194 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:14:09.715249 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:09.715251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:09.715271 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:09.715362 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:09.716164 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:09.717483 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:09.718768 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:09.719180 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:09.719298 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:09.721690 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:09.721694 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:09.721694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:09.721706 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:09.723707 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:09.724129 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:09.724135 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:09.724135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:09.724237 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:09.724507 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:09.724509 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:09.724509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:09.724772 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:09.724871 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:09.725159 (+ 288us) server_negotiation.cc:299] Negotiation successful
0810 04:14:09.725314 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":82,"threads_started":1}
I20260810 04:14:09.725581 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:09.714880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38093 (local address 127.10.249.130:48675)
0810 04:14:09.715006 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:09.715014 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:09.715066 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:09.715438 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:09.715442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:09.715782 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:09.716034 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:09.716042 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:09.717619 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:09.717620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:09.718656 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:09.718659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:09.719281 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:09.719283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:09.719397 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:09.720049 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:09.720054 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:09.721563 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:09.723802 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:09.723808 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:09.723810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:09.724018 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:09.724320 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:09.724321 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:09.724321 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:09.724427 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:09.724849 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:09.724856 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:09.724996 (+ 140us) client_negotiation.cc:769] Sending connection context
0810 04:14:09.725102 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 04:14:09.725376 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":212,"thread_start_us":83,"threads_started":1}
I20260810 04:14:09.726280 27020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe6647527b241cda80f8d8cd02f1c55" candidate_uuid: "f294539b15214f77b0887f2d61b147d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" is_pre_election: true
I20260810 04:14:09.726436 27020 raft_consensus.cc:2454] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f294539b15214f77b0887f2d61b147d4 in term 1.
W20260810 04:14:09.726702 27094 leader_election.cc:341] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047): Not found: Tablet not found: afe6647527b241cda80f8d8cd02f1c55
I20260810 04:14:09.726830 27094 leader_election.cc:302] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bb2d4e7de894f019a7ae290cc31c6e7, f294539b15214f77b0887f2d61b147d4; no voters: 4004080187a94ccdbcd51dfff8e65345
I20260810 04:14:09.726933 27366 raft_consensus.cc:2781] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 04:14:09.726996 27366 raft_consensus.cc:482] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:14:09.727020 27366 raft_consensus.cc:3037] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:14:09.728142 27366 raft_consensus.cc:504] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:09.728284 27366 leader_election.cc:288] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047), 6bb2d4e7de894f019a7ae290cc31c6e7 (127.10.249.129:38093)
I20260810 04:14:09.728475 27020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe6647527b241cda80f8d8cd02f1c55" candidate_uuid: "f294539b15214f77b0887f2d61b147d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7"
W20260810 04:14:09.728536 27094 leader_election.cc:341] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047): Not found: Tablet not found: afe6647527b241cda80f8d8cd02f1c55
I20260810 04:14:09.728569 27020 raft_consensus.cc:3037] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:14:09.729692 27020 raft_consensus.cc:2454] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f294539b15214f77b0887f2d61b147d4 in term 2.
I20260810 04:14:09.729884 27094 leader_election.cc:302] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bb2d4e7de894f019a7ae290cc31c6e7, f294539b15214f77b0887f2d61b147d4; no voters: 4004080187a94ccdbcd51dfff8e65345
I20260810 04:14:09.729995 27366 raft_consensus.cc:2781] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:14:09.730123 27366 raft_consensus.cc:686] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [term 2 LEADER]: Becoming Leader. State: Replica: f294539b15214f77b0887f2d61b147d4, State: Running, Role: LEADER
I20260810 04:14:09.730228 27366 consensus_queue.cc:237] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:09.730516 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:09.730376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:37273)
0810 04:14:09.730445 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:09.730481 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260810 04:14:10.109524 27094 consensus_peers.cc:487] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 -> Peer 4004080187a94ccdbcd51dfff8e65345 (127.10.249.131:38047): Couldn't send request to peer 4004080187a94ccdbcd51dfff8e65345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afe6647527b241cda80f8d8cd02f1c55. This is attempt 1: this message will repeat every 5th retry.
I20260810 04:14:10.321364 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.321089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:43987)
0810 04:14:10.321283 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:10.321320 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":59,"threads_started":1}
I20260810 04:14:10.326843 27020 raft_consensus.cc:1261] T afe6647527b241cda80f8d8cd02f1c55 P 6bb2d4e7de894f019a7ae290cc31c6e7 [term 2 FOLLOWER]: Refusing update from remote peer f294539b15214f77b0887f2d61b147d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260810 04:14:10.327183 27366 consensus_queue.cc:1035] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260810 04:14:10.327927 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.327828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:44557)
0810 04:14:10.327871 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:10.327906 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 04:14:10.328832 27378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.328689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:53511)
0810 04:14:10.328761 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:10.328796 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55,"thread_start_us":37,"threads_started":1}
I20260810 04:14:10.328898 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.328810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:60355)
0810 04:14:10.328840 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:10.328863 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260810 04:14:10.531296 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.531007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:53841)
0810 04:14:10.531222 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:10.531261 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":71,"threads_started":1}
I20260810 04:14:10.722981 27380 ts_tablet_manager.cc:927] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Initiating tablet copy from peer f294539b15214f77b0887f2d61b147d4 (127.10.249.130:35759)
I20260810 04:14:10.723265 27380 tablet_copy_client.cc:316] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: tablet copy: Beginning tablet copy session from remote peer at address 127.10.249.130:35759
Aug 10 04:14:10 dist-test-slave-0kls krb5kdc[25673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335248, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.130@KRBTEST.COM
I20260810 04:14:10.730309 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.723582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:35759 (local address 127.10.249.131:60361)
0810 04:14:10.723655 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:10.723686 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:10.723765 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:10.724003 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:10.724008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:10.724281 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:10.724354 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:10.724356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:10.725117 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:10.725118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:10.725664 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:10.725666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:10.726150 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:10.726151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:10.726229 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:10.726779 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:10.726783 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:10.728016 (+ 1233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:10.729344 (+ 1328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:10.729351 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:10.729353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:10.729518 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:10.729708 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:10.729709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:10.729709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:10.729759 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:10.730049 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:10.730055 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:10.730099 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 04:14:10.730159 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:14:10.730238 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 04:14:10.730320 27382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.723682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:60361 (local address 127.10.249.130:35759)
0810 04:14:10.723862 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:10.723867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:10.723877 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:14:10.723901 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:10.723902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:10.723917 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:10.723983 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:10.724423 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:10.725053 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:10.725742 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:10.726088 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:10.726141 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:10.728084 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:10.728090 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:10.728090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:10.728095 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:10.729280 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:10.729600 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:10.729602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:10.729602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:10.729652 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:10.729867 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:10.729871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:10.729872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:10.729994 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:10.730053 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:10.730202 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 04:14:10.730259 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
I20260810 04:14:10.730738 27188 tablet_copy_service.cc:140] P f294539b15214f77b0887f2d61b147d4: Received BeginTabletCopySession request for tablet afe6647527b241cda80f8d8cd02f1c55 from peer 4004080187a94ccdbcd51dfff8e65345 ({username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:60361)
I20260810 04:14:10.730826 27188 tablet_copy_service.cc:161] P f294539b15214f77b0887f2d61b147d4: Beginning new tablet copy session on tablet afe6647527b241cda80f8d8cd02f1c55 from peer 4004080187a94ccdbcd51dfff8e65345 at {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:60361: session id = 4004080187a94ccdbcd51dfff8e65345-afe6647527b241cda80f8d8cd02f1c55
I20260810 04:14:10.731283 27188 tablet_copy_source_session.cc:205] T afe6647527b241cda80f8d8cd02f1c55 P f294539b15214f77b0887f2d61b147d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 04:14:10.732187 27380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afe6647527b241cda80f8d8cd02f1c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:10.734711 27380 tablet_copy_client.cc:791] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: tablet copy: Starting download of 0 data blocks...
I20260810 04:14:10.734864 27380 tablet_copy_client.cc:655] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: tablet copy: Starting download of 1 WAL segments...
I20260810 04:14:10.735625 27380 tablet_copy_client.cc:531] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 04:14:10.736243 27380 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Bootstrap starting.
I20260810 04:14:10.737465 27380 log.cc:824] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:10.739820 27380 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:14:10.739996 27380 tablet_bootstrap.cc:492] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Bootstrap complete.
I20260810 04:14:10.740088 27380 ts_tablet_manager.cc:1397] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260810 04:14:10.740914 27380 raft_consensus.cc:348] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:10.741062 27380 raft_consensus.cc:729] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4004080187a94ccdbcd51dfff8e65345, State: Initialized, Role: FOLLOWER
I20260810 04:14:10.741196 27380 consensus_queue.cc:260] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f294539b15214f77b0887f2d61b147d4" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 35759 } } peers { permanent_uuid: "4004080187a94ccdbcd51dfff8e65345" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38047 } } peers { permanent_uuid: "6bb2d4e7de894f019a7ae290cc31c6e7" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38093 } }
I20260810 04:14:10.741478 27380 ts_tablet_manager.cc:1428] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345: Time spent starting tablet: real 0.001s user 0.000s sys 0.003s
I20260810 04:14:10.741736 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.741624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:44799)
0810 04:14:10.741680 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:10.741709 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 04:14:10.741815 27188 tablet_copy_service.cc:342] P f294539b15214f77b0887f2d61b147d4: Request end of tablet copy session 4004080187a94ccdbcd51dfff8e65345-afe6647527b241cda80f8d8cd02f1c55 received from {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:60361
I20260810 04:14:10.741869 27188 tablet_copy_service.cc:433] P f294539b15214f77b0887f2d61b147d4: ending tablet copy session 4004080187a94ccdbcd51dfff8e65345-afe6647527b241cda80f8d8cd02f1c55 on tablet afe6647527b241cda80f8d8cd02f1c55 with peer 4004080187a94ccdbcd51dfff8e65345
I20260810 04:14:10.742095 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:10.742021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:44733)
0810 04:14:10.742051 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:10.742076 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260810 04:14:11.207677 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:11.207471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:60801)
0810 04:14:11.207589 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:11.207627 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260810 04:14:11.207640 27311 raft_consensus.cc:1203] T afe6647527b241cda80f8d8cd02f1c55 P 4004080187a94ccdbcd51dfff8e65345 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260810 04:14:11.208081 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:11.207972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:46059)
0810 04:14:11.208027 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:11.208055 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 04:14:11.329473 27388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:11.329295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:49859)
0810 04:14:11.329395 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:11.329428 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":50,"threads_started":1}
I20260810 04:14:12.208407 27389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:12.208117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:46791)
0810 04:14:12.208300 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:12.208346 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
I20260810 04:14:12.208683 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:12.208462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:32919)
0810 04:14:12.208604 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:12.208634 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260810 04:14:12.330282 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:12.330010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:34191)
0810 04:14:12.330193 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:12.330235 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260810 04:14:13.209376 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:13.209107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:38013)
0810 04:14:13.209278 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:13.209320 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260810 04:14:13.209641 27393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:13.209221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:37477)
0810 04:14:13.209381 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:13.209424 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260810 04:14:13.330993 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:13.330748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:37761)
0810 04:14:13.330912 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:13.330948 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":74,"threads_started":1}
I20260810 04:14:14.210260 27395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:14.210050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:49129)
0810 04:14:14.210176 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:14.210214 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260810 04:14:14.210340 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:14.210143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:58375)
0810 04:14:14.210271 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:14.210300 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
I20260810 04:14:14.210704 27395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:14.210609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:47709)
0810 04:14:14.210662 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:14.210687 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 04:14:14.331676 27397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:14.331445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:47601)
0810 04:14:14.331578 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:14.331613 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260810 04:14:15.211028 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:15.210793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:58047)
0810 04:14:15.210927 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:15.210967 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260810 04:14:15.211304 27399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:15.211120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:45573)
0810 04:14:15.211227 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:15.211256 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":56,"threads_started":1}
I20260810 04:14:15.332520 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:15.332318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:53779)
0810 04:14:15.332439 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:15.332474 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260810 04:14:16.211776 27401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:16.211457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:38965)
0810 04:14:16.211635 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:16.211714 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":57,"threads_started":1}
I20260810 04:14:16.212023 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:16.211780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:33475)
0810 04:14:16.211950 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:16.211978 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":60,"threads_started":1}
I20260810 04:14:16.333361 27405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:16.333060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:52673)
0810 04:14:16.333277 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:16.333316 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":60,"threads_started":1}
I20260810 04:14:17.212577 27406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:17.212373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:60315)
0810 04:14:17.212503 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:17.212532 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":80,"threads_started":1}
I20260810 04:14:17.212656 27407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:17.212467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:44277)
0810 04:14:17.212576 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:17.212610 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":71,"threads_started":1}
I20260810 04:14:17.334237 27408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:17.334017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:45649)
0810 04:14:17.334156 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:17.334192 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":64,"threads_started":1}
I20260810 04:14:18.213249 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:18.213054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:46857)
0810 04:14:18.213178 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:18.213205 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260810 04:14:18.213261 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:18.213054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:53193)
0810 04:14:18.213197 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:18.213224 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":69,"threads_started":1}
I20260810 04:14:18.334903 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:18.334697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:53069)
0810 04:14:18.334827 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:18.334859 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260810 04:14:19.213856 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:19.213612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:46551)
0810 04:14:19.213731 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:19.213761 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260810 04:14:19.213856 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:19.213653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:47685)
0810 04:14:19.213758 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:19.213809 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":56,"threads_started":1}
I20260810 04:14:19.335628 27414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:19.335316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:47725)
0810 04:14:19.335547 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:19.335582 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":84,"threads_started":1}
I20260810 04:14:20.214552 27416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:20.214341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:37471)
0810 04:14:20.214473 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:20.214505 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260810 04:14:20.214574 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:20.214344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:59047)
0810 04:14:20.214502 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:20.214534 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":76,"threads_started":1}
I20260810 04:14:20.336525 27417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:20.336230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:57455)
0810 04:14:20.336443 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:20.336481 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":74,"threads_started":1}
I20260810 04:14:21.215247 27418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:21.215028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:54845)
0810 04:14:21.215165 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:21.215200 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260810 04:14:21.215276 27419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:21.215053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:39233)
0810 04:14:21.215188 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:21.215237 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":60,"threads_started":1}
I20260810 04:14:21.337131 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:21.336945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:49877)
0810 04:14:21.337053 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:21.337085 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":54,"threads_started":1}
I20260810 04:14:22.216171 27421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:22.215921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:37871)
0810 04:14:22.216067 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:22.216121 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":64,"threads_started":1}
I20260810 04:14:22.216243 27422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:22.215971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:44781)
0810 04:14:22.216120 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:22.216182 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260810 04:14:22.337955 27423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:22.337701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:59445)
0810 04:14:22.337870 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:22.337908 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":64,"threads_started":1}
I20260810 04:14:23.217001 27424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:23.216742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.130:44457)
0810 04:14:23.216917 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:23.216952 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":75,"threads_started":1}
I20260810 04:14:23.217017 27425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:23.216755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.131:43217)
0810 04:14:23.216940 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:23.216976 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":95,"threads_started":1}
I20260810 04:14:23.338611 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:23.338406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:45857 (local address 127.10.249.129:57997)
0810 04:14:23.338538 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:23.338568 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:45857: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260810 04:14:23.535962 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 26897
I20260810 04:14:23.543959 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 27074
I20260810 04:14:23.549446 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 27221
2026-08-10T04:14:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18454 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:14:23 dist-test-slave-0kls krb5kdc[27430](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:14:23 dist-test-slave-0kls krb5kdc[27430](info): set up 2 sockets
Aug 10 04:14:23 dist-test-slave-0kls krb5kdc[27430](info): commencing operation
krb5kdc: starting...
W20260810 04:14:24.514007 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.943s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:14:24 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:14:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:14:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:14:24.624399 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38601
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:38601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:24.699450 27443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:24.699658 27443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:24.699700 27443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:24.700834 27443 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 04:14:24.700899 27443 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 04:14:24.700924 27443 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 04:14:24.700954 27443 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:24.700978 27443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:24.701009 27443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:24.701047 27443 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:24.701073 27443 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:24.702464 27443 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:38601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:24.702724 27443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:24.702924 27443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:24.707476 27449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:24.707513 27448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:24.707509 27443 server_base.cc:1034] running on GCE node
W20260810 04:14:24.707484 27451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:24.707866 27443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:24.708123 27443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:24.709278 27443 hybrid_clock.cc:648] HybridClock initialized: now 1786335264709269 us; error 26 us; skew 500 ppm
Aug 10 04:14:24 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335264, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:24.720228 27443 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:14:24.720715 27443 webserver.cc:460] Webserver started at http://127.10.249.190:35403/ using document root <none> and password file <none>
I20260810 04:14:24.720944 27443 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:24.721030 27443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:24.721165 27443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:24.722131 27443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "bad34d9b97534717ac7767e3f614b55e"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "8d6f2012da4ce306238e530137f8a870"
server_key_iv: "bc6cebc87fdf4025ad4ba215a6187a06"
server_key_version: "encryptionkey@0"
I20260810 04:14:24.722450 27443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "bad34d9b97534717ac7767e3f614b55e"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "8d6f2012da4ce306238e530137f8a870"
server_key_iv: "bc6cebc87fdf4025ad4ba215a6187a06"
server_key_version: "encryptionkey@0"
I20260810 04:14:24.723717 27443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:24.724364 27459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:24.724552 27443 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:24.724666 27443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "bad34d9b97534717ac7767e3f614b55e"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "8d6f2012da4ce306238e530137f8a870"
server_key_iv: "bc6cebc87fdf4025ad4ba215a6187a06"
server_key_version: "encryptionkey@0"
I20260810 04:14:24.724740 27443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:24.731946 27443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:24.734347 27443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:24.734510 27443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:24.738598 27443 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:38601
I20260810 04:14:24.738636 27515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:38601 every 8 connection(s)
I20260810 04:14:24.739028 27443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:14:24.739894 27516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:24.742209 27516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Bootstrap starting.
I20260810 04:14:24.742790 27516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:24.743095 27516 log.cc:824] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:24.743805 27516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: No bootstrap required, opened a new log
I20260810 04:14:24.745388 27516 raft_consensus.cc:348] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:14:24.745527 27516 raft_consensus.cc:374] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:24.745576 27516 raft_consensus.cc:729] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad34d9b97534717ac7767e3f614b55e, State: Initialized, Role: FOLLOWER
I20260810 04:14:24.745750 27516 consensus_queue.cc:260] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:14:24.745872 27516 raft_consensus.cc:388] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:14:24.745918 27516 raft_consensus.cc:482] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:14:24.745967 27516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:24.746522 27516 raft_consensus.cc:504] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:14:24.746639 27516 leader_election.cc:302] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bad34d9b97534717ac7767e3f614b55e; no voters:
I20260810 04:14:24.746803 27516 leader_election.cc:288] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:14:24.746852 27519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:14:24.747017 27519 raft_consensus.cc:686] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 1 LEADER]: Becoming Leader. State: Replica: bad34d9b97534717ac7767e3f614b55e, State: Running, Role: LEADER
I20260810 04:14:24.747068 27516 sys_catalog.cc:564] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:24.747193 27519 consensus_queue.cc:237] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:14:24.747910 27520 sys_catalog.cc:455] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bad34d9b97534717ac7767e3f614b55e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } } }
I20260810 04:14:24.747932 27521 sys_catalog.cc:455] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bad34d9b97534717ac7767e3f614b55e. Latest consensus state: current_term: 1 leader_uuid: "bad34d9b97534717ac7767e3f614b55e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } } }
I20260810 04:14:24.748009 27520 sys_catalog.cc:458] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:24.748025 27521 sys_catalog.cc:458] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:24.748281 27528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:14:24.748838 27528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:14:24.749104 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 27443
I20260810 04:14:24.749197 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:14:24.749418 11238 external_mini_cluster.cc:1428] Setting key a7450a38f066c92c09a4792b1dd2825a
I20260810 04:14:24.750816 27528 catalog_manager.cc:1347] Generated new cluster ID: 8a3df3ddfa0442ce8d0e9455444a6d47
I20260810 04:14:24.750881 27528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:14:24 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:24.757043 27528 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:14:24.757697 27528 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:14:24.760968 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:24.749991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59924 (local address 127.10.249.190:38601)
0810 04:14:24.750189 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:24.750200 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:24.750236 (+ 36us) server_negotiation.cc:407] Connection header received
0810 04:14:24.750345 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:24.750354 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:24.750430 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:24.750569 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:24.751335 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:24.752638 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:24.753666 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:24.754314 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:24.756872 (+ 2558us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:24.757423 (+ 551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:24.757427 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:24.757427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:24.757438 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:24.759357 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:24.759777 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:24.759780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:24.759781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:24.759900 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:24.760115 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:24.760115 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:24.760116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:24.760361 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:24.760497 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:24.760612 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 04:14:24.760756 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260810 04:14:24.765185 27528 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Generated new TSK 0
I20260810 04:14:24.765342 27528 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:14:24.794996 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38601
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:24.871796 27543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:24.871973 27543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:24.871994 27543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:24.873005 27543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:24.873049 27543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:24.873093 27543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:14:24.874634 27543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:24.874886 27543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:24.875128 27543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:24.880136 27548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:24.880147 27549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:24.880148 27551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:24.880211 27543 server_base.cc:1034] running on GCE node
I20260810 04:14:24.880533 27543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:24.880784 27543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:24.881958 27543 hybrid_clock.cc:648] HybridClock initialized: now 1786335264881940 us; error 30 us; skew 500 ppm
Aug 10 04:14:24 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335264, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:24.884349 27543 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:14:24.884867 27543 webserver.cc:460] Webserver started at http://127.10.249.129:33953/ using document root <none> and password file <none>
I20260810 04:14:24.885121 27543 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:24.885192 27543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:24.885342 27543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:24.886394 27543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "ca00073dda214dac803f01bb1785d61c"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "66a9ded456693964067e03c2e1fec816"
server_key_iv: "fedaa1bcd2949209c89413a57eb0963d"
server_key_version: "encryptionkey@0"
I20260810 04:14:24.886731 27543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "ca00073dda214dac803f01bb1785d61c"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "66a9ded456693964067e03c2e1fec816"
server_key_iv: "fedaa1bcd2949209c89413a57eb0963d"
server_key_version: "encryptionkey@0"
I20260810 04:14:24.887982 27543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:14:24.888736 27558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:24.888886 27543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:24.888965 27543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "ca00073dda214dac803f01bb1785d61c"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "66a9ded456693964067e03c2e1fec816"
server_key_iv: "fedaa1bcd2949209c89413a57eb0963d"
server_key_version: "encryptionkey@0"
I20260810 04:14:24.889014 27543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:24.900161 27543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:24.902195 27543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:24.902295 27543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:24.902443 27543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:24.902665 27543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:24.902697 27543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:24.902717 27543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:24.902729 27543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:24.908154 27543 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:37181
I20260810 04:14:24.908236 27679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:37181 every 8 connection(s)
I20260810 04:14:24.908552 27543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:14:24.909160 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 27543
I20260810 04:14:24.909286 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:14:24.909479 11238 external_mini_cluster.cc:1428] Setting key 4c83f4fe7c43134e2c5429e8cbd4e23c
Aug 10 04:14:24 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335264, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:24.918754 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:24.909271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:50091 (local address 127.10.249.190:38601)
0810 04:14:24.909321 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:24.909323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:24.909582 (+ 259us) server_negotiation.cc:407] Connection header received
0810 04:14:24.910220 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:24.910221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:24.910234 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:24.910296 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:24.911143 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:24.911852 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:24.913294 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:24.913498 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:24.913545 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:24.915970 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:24.915972 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:24.915974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:24.915982 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:24.917430 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:24.917828 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:24.917830 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:24.917830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:24.917891 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:24.918120 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:24.918121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:24.918121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:24.918268 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:24.918336 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:24.918567 (+ 231us) server_negotiation.cc:299] Negotiation successful
0810 04:14:24.918666 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:14:24.918779 27682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:24.909270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:50091)
0810 04:14:24.909439 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:24.909478 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:24.910101 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:24.910366 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:24.910369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:24.910873 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:24.911049 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:24.911053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:24.911958 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:24.911959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:24.913212 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:24.913216 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:24.913575 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:24.913576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:24.913744 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:24.914247 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:24.914258 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:24.915875 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:24.917505 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:24.917511 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:24.917513 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:24.917735 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:24.917958 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:24.917958 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:24.917959 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:24.918053 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:24.918338 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:24.918342 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:24.918443 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 04:14:24.918514 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 04:14:24.918622 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
I20260810 04:14:24.919323 27680 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38601
I20260810 04:14:24.919400 27680 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:24.919528 27680 heartbeater.cc:511] Master 127.10.249.190:38601 requested a full tablet report, sending...
I20260810 04:14:24.920135 27477 ts_manager.cc:194] Registered new tserver with Master: ca00073dda214dac803f01bb1785d61c (127.10.249.129:37181)
I20260810 04:14:24.920751 27477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:50091
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:14:24.935808 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38601
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:25.008137 27687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:25.008314 27687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:25.008334 27687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:25.009270 27687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:25.009299 27687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:25.009333 27687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:14:25.010773 27687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:25.011008 27687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:25.011243 27687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:25.015604 27692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:25.015663 27687 server_base.cc:1034] running on GCE node
W20260810 04:14:25.015756 27695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:25.015657 27693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:25.016016 27687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:25.016223 27687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:25.017354 27687 hybrid_clock.cc:648] HybridClock initialized: now 1786335265017342 us; error 27 us; skew 500 ppm
Aug 10 04:14:25 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335265, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:25.019523 27687 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:14:25.019989 27687 webserver.cc:460] Webserver started at http://127.10.249.130:40769/ using document root <none> and password file <none>
I20260810 04:14:25.020203 27687 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:25.020249 27687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:25.020390 27687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:25.021322 27687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "fc0500332e174645bfb46d0877f6ac40"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "93562e5a4699b06b5dc40bf34cb223be"
server_key_iv: "94a13cf35f6e2115d3089aafc9312705"
server_key_version: "encryptionkey@0"
I20260810 04:14:25.021637 27687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "fc0500332e174645bfb46d0877f6ac40"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "93562e5a4699b06b5dc40bf34cb223be"
server_key_iv: "94a13cf35f6e2115d3089aafc9312705"
server_key_version: "encryptionkey@0"
I20260810 04:14:25.022943 27687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:14:25.023644 27703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:25.023838 27687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:14:25.023934 27687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "fc0500332e174645bfb46d0877f6ac40"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "93562e5a4699b06b5dc40bf34cb223be"
server_key_iv: "94a13cf35f6e2115d3089aafc9312705"
server_key_version: "encryptionkey@0"
I20260810 04:14:25.024003 27687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:25.030822 27687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:25.032485 27687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:25.032637 27687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:25.032859 27687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:25.033133 27687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:25.033165 27687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:25.033185 27687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:25.033228 27687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:25.038621 27687 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:46319
I20260810 04:14:25.038667 27819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:46319 every 8 connection(s)
I20260810 04:14:25.038913 27687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:14:25.039783 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 27687
I20260810 04:14:25.039933 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:14:25.040117 11238 external_mini_cluster.cc:1428] Setting key b97c04706cb39a4177ee21d966980994
Aug 10 04:14:25 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335265, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:25.048264 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.039493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:56853 (local address 127.10.249.190:38601)
0810 04:14:25.039567 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.039569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.039762 (+ 193us) server_negotiation.cc:407] Connection header received
0810 04:14:25.040350 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.040352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.040366 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.040423 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:25.041611 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.042088 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.043076 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.043357 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.043419 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.045716 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:25.045718 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:25.045718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:25.045724 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:25.046958 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:25.047401 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:25.047402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:25.047402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:25.047446 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:25.047703 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:25.047703 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:25.047704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:25.047790 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:25.047866 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.048152 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.048208 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:14:25.048483 27822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.039444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:56853)
0810 04:14:25.039643 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:25.039676 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:25.040267 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:25.040506 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:25.040510 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:25.041285 (+ 775us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:25.041518 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.041524 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.042165 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.042166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.042997 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.043000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.043431 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.043432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.043523 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.043939 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:25.043947 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:25.045589 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:25.047034 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:25.047041 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:25.047043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:25.047334 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:25.047507 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:25.047508 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:25.047508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:25.047630 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:25.047858 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:25.047864 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:25.048028 (+ 164us) client_negotiation.cc:769] Sending connection context
0810 04:14:25.048137 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 04:14:25.048280 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":80,"threads_started":1}
I20260810 04:14:25.048956 27820 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38601
I20260810 04:14:25.049048 27820 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:25.049216 27820 heartbeater.cc:511] Master 127.10.249.190:38601 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
I20260810 04:14:25.049573 27477 ts_manager.cc:194] Registered new tserver with Master: fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319)
I20260810 04:14:25.049976 27477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:56853
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:14:25.065156 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38601
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:25.138818 27825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:25.139008 27825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:25.139041 27825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:25.140075 27825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:25.140177 27825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:25.140225 27825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:14:25.141571 27825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:25.141829 27825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:25.142045 27825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:25.146607 27831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:25.146628 27833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:25.146615 27830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:25.146641 27825 server_base.cc:1034] running on GCE node
I20260810 04:14:25.146927 27825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:25.147149 27825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:25.148278 27825 hybrid_clock.cc:648] HybridClock initialized: now 1786335265148270 us; error 25 us; skew 500 ppm
Aug 10 04:14:25 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335265, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:25.150552 27825 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:14:25.150952 27825 webserver.cc:460] Webserver started at http://127.10.249.131:33983/ using document root <none> and password file <none>
I20260810 04:14:25.151157 27825 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:25.151199 27825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:25.151343 27825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:14:25.152184 27825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "386a9742afdb4c9080ac85c9a2c6f2e2"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "a58a8c5e717b40e880fd384653f55d14"
server_key_iv: "cdbf299d064ee72e2b6f3e2b3cc5c34c"
server_key_version: "encryptionkey@0"
I20260810 04:14:25.152491 27825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "386a9742afdb4c9080ac85c9a2c6f2e2"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "a58a8c5e717b40e880fd384653f55d14"
server_key_iv: "cdbf299d064ee72e2b6f3e2b3cc5c34c"
server_key_version: "encryptionkey@0"
I20260810 04:14:25.153644 27825 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:14:25.154366 27841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:25.154561 27825 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:25.154654 27825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "386a9742afdb4c9080ac85c9a2c6f2e2"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "a58a8c5e717b40e880fd384653f55d14"
server_key_iv: "cdbf299d064ee72e2b6f3e2b3cc5c34c"
server_key_version: "encryptionkey@0"
I20260810 04:14:25.154732 27825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:25.168799 27825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:25.170353 27825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:25.170488 27825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:25.170668 27825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:25.170915 27825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:25.170944 27825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:25.170962 27825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:25.171006 27825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:25.176301 27825 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:38739
I20260810 04:14:25.176352 27958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:38739 every 8 connection(s)
I20260810 04:14:25.176617 27825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:14:25.179447 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 27825
I20260810 04:14:25.179548 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:14:25.179718 11238 external_mini_cluster.cc:1428] Setting key 8fa0a6745b516ac2aad7126c79df773e
Aug 10 04:14:25 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335265, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:25.184798 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.177211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:41073 (local address 127.10.249.190:38601)
0810 04:14:25.177252 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.177253 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.177447 (+ 194us) server_negotiation.cc:407] Connection header received
0810 04:14:25.177904 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.177905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.177917 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.177966 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:25.178732 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.179170 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.180550 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.180807 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.180877 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.182628 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:25.182630 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:25.182630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:25.182637 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:25.183812 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:25.184096 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:25.184096 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:25.184097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:25.184140 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:25.184314 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:25.184315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:25.184315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:25.184398 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:25.184443 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.184676 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.184737 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:14:25.184914 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.177174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:41073)
0810 04:14:25.177326 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:25.177383 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:25.177777 (+ 394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:25.178020 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:25.178023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:25.178481 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:25.178635 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.178639 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.179252 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.179253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.180473 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.180476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.180895 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.180896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.181014 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.181348 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:25.181355 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:25.182554 (+ 1199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:25.183872 (+ 1318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:25.183876 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:25.183877 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:25.184042 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:25.184189 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:25.184190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:25.184190 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:25.184268 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:25.184447 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:25.184450 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:25.184571 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 04:14:25.184648 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:14:25.184754 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260810 04:14:25.185364 27959 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38601
I20260810 04:14:25.185436 27959 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:25.185607 27959 heartbeater.cc:511] Master 127.10.249.190:38601 requested a full tablet report, sending...
I20260810 04:14:25.186007 27477 ts_manager.cc:194] Registered new tserver with Master: 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
I20260810 04:14:25.186347 27477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:41073
I20260810 04:14:25.191424 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:14:25.198508 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.192652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59926 (local address 127.10.249.190:38601)
0810 04:14:25.192715 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.192717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.192816 (+ 99us) server_negotiation.cc:407] Connection header received
0810 04:14:25.192885 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.192886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.192894 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.192941 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:25.193429 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.193872 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.194547 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.194754 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.194838 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.195877 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:25.195878 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:25.195879 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:25.195885 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:25.197286 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:25.197691 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:25.197692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:25.197692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:25.197740 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:25.197967 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:25.197968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:25.197968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:25.198110 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:25.198217 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.198337 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.198410 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:14:25.200028 27477 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:14:25.201486 27477 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:14:25.207334 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.203411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46319 (local address 127.0.0.1:37654)
0810 04:14:25.203875 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:25.203885 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:25.203932 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:25.204158 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:25.204160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:25.204162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:25.204193 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.204194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.205546 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.205547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.206289 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.206292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.207076 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.207077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.207156 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.207172 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 04:14:25.207229 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 04:14:25.207276 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":105,"threads_started":1}
I20260810 04:14:25.207406 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.203397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37181 (local address 127.0.0.1:54978)
0810 04:14:25.203519 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:25.203551 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:25.203605 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:25.203991 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:25.203994 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:25.203996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:25.204058 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.204060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.205282 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.205283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.206439 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.206441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.207196 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.207197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.207252 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.207256 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:14:25.207308 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 04:14:25.207345 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"mutex_wait_us":48,"thread_start_us":66,"threads_started":1}
I20260810 04:14:25.207425 27972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.203698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54978 (local address 127.10.249.129:37181)
0810 04:14:25.203839 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.203843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.203855 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:14:25.203893 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.203896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.203911 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.203986 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:25.204121 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.205195 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.206511 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.207086 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.207188 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.207235 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.207322 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.207357 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":81,"threads_started":1}
I20260810 04:14:25.207638 27973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.203798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37654 (local address 127.10.249.130:46319)
0810 04:14:25.203943 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.203947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.203955 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:14:25.203991 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.203993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.204006 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.204080 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:25.204410 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.205442 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.206379 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.206994 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.207067 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.207120 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.207528 (+ 408us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.207570 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260810 04:14:25.207826 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.203641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50656 (local address 127.10.249.131:38739)
0810 04:14:25.203765 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.203769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.204058 (+ 289us) server_negotiation.cc:407] Connection header received
0810 04:14:25.204169 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.204171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.204186 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.204252 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:25.204435 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.205134 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.206700 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.207122 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.207187 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.207234 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.207723 (+ 489us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.207760 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
I20260810 04:14:25.208060 27611 tablet_service.cc:1467] Processing CreateTablet for tablet 391773f9b82b4a079d045fe8aba64888 (DEFAULT_TABLE table=test-table [id=e8e936f98fb74534bbd79f2b8844f597]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:25.208302 27752 tablet_service.cc:1467] Processing CreateTablet for tablet 391773f9b82b4a079d045fe8aba64888 (DEFAULT_TABLE table=test-table [id=e8e936f98fb74534bbd79f2b8844f597]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:25.208408 27611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 391773f9b82b4a079d045fe8aba64888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:25.208590 27752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 391773f9b82b4a079d045fe8aba64888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:25.209903 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.203418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38739 (local address 127.0.0.1:50656)
0810 04:14:25.204008 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:25.204016 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:25.204079 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:25.204264 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:25.204265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:25.204267 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:25.204323 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.204324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.205240 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.205241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.206634 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.206636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.207554 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.207555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.207606 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.207609 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:14:25.209827 (+ 2218us) client_negotiation.cc:240] Negotiation successful
0810 04:14:25.209863 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":33,"thread_start_us":102,"threads_started":1}
I20260810 04:14:25.211526 27974 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Bootstrap starting.
I20260810 04:14:25.211978 27891 tablet_service.cc:1467] Processing CreateTablet for tablet 391773f9b82b4a079d045fe8aba64888 (DEFAULT_TABLE table=test-table [id=e8e936f98fb74534bbd79f2b8844f597]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:25.212126 27974 tablet_bootstrap.cc:654] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:25.212266 27891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 391773f9b82b4a079d045fe8aba64888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:25.212628 27974 log.cc:824] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:25.212942 27975 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Bootstrap starting.
I20260810 04:14:25.213244 27974 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: No bootstrap required, opened a new log
I20260810 04:14:25.213320 27974 ts_tablet_manager.cc:1397] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:14:25.213574 27975 tablet_bootstrap.cc:654] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:25.214094 27975 log.cc:824] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:25.214847 27975 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: No bootstrap required, opened a new log
I20260810 04:14:25.214967 27975 ts_tablet_manager.cc:1397] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:14:25.215343 27978 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: Bootstrap starting.
I20260810 04:14:25.215342 27974 raft_consensus.cc:348] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.215530 27974 raft_consensus.cc:374] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:25.215572 27974 raft_consensus.cc:729] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca00073dda214dac803f01bb1785d61c, State: Initialized, Role: FOLLOWER
I20260810 04:14:25.215791 27974 consensus_queue.cc:260] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.216008 27978 tablet_bootstrap.cc:654] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:25.216037 27974 ts_tablet_manager.cc:1428] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:14:25.216137 27680 heartbeater.cc:503] Master 127.10.249.190:38601 was elected leader, sending a full tablet report...
I20260810 04:14:25.216523 27978 log.cc:824] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:25.216789 27975 raft_consensus.cc:348] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.216939 27975 raft_consensus.cc:374] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:25.216986 27975 raft_consensus.cc:729] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0500332e174645bfb46d0877f6ac40, State: Initialized, Role: FOLLOWER
I20260810 04:14:25.217077 27975 consensus_queue.cc:260] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.217211 27978 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: No bootstrap required, opened a new log
I20260810 04:14:25.217284 27978 ts_tablet_manager.cc:1397] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:14:25.217343 27975 ts_tablet_manager.cc:1428] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:14:25.217360 27820 heartbeater.cc:503] Master 127.10.249.190:38601 was elected leader, sending a full tablet report...
I20260810 04:14:25.218698 27978 raft_consensus.cc:348] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.218833 27978 raft_consensus.cc:374] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:25.218869 27978 raft_consensus.cc:729] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386a9742afdb4c9080ac85c9a2c6f2e2, State: Initialized, Role: FOLLOWER
I20260810 04:14:25.218981 27978 consensus_queue.cc:260] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.219255 27978 ts_tablet_manager.cc:1428] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:14:25.219292 27959 heartbeater.cc:503] Master 127.10.249.190:38601 was elected leader, sending a full tablet report...
W20260810 04:14:25.289479 27821 tablet.cc:2369] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:14:25.298588 27982 raft_consensus.cc:482] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:14:25.298704 27982 raft_consensus.cc:504] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.299098 27982 leader_election.cc:288] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca00073dda214dac803f01bb1785d61c (127.10.249.129:37181), fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319)
I20260810 04:14:25.302982 27972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.299329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:42107 (local address 127.10.249.129:37181)
0810 04:14:25.299371 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.299373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.299405 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:14:25.299435 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.299436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.299458 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.299510 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:25.299723 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.300469 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.302044 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.302640 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.302716 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.302724 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.302884 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.302920 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:14:25.302982 27973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.299340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:50573 (local address 127.10.249.130:46319)
0810 04:14:25.299384 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.299386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.299561 (+ 175us) server_negotiation.cc:407] Connection header received
0810 04:14:25.299593 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.299594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.299601 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.299652 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:25.299836 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.300498 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.302046 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.302639 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.302716 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.302724 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.302887 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.302921 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:14:25.302983 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.299262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37181 (local address 127.10.249.131:42107)
0810 04:14:25.299302 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:25.299314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:25.299354 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:25.299540 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:25.299542 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:25.299543 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:25.299617 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.299618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.300566 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.300567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.301954 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.301958 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.302726 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.302727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.302805 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.302807 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:14:25.302855 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 04:14:25.302898 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":86}
I20260810 04:14:25.302992 27983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.299263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46319 (local address 127.10.249.131:50573)
0810 04:14:25.299472 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:25.299479 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:25.299540 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:25.299679 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:25.299680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:25.299682 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:25.299752 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.299753 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.300567 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.300567 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.301954 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:25.301958 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.302726 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.302727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:25.302797 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.302801 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:14:25.302855 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:14:25.302898 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":118,"thread_start_us":90,"threads_started":1}
I20260810 04:14:25.303332 27773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391773f9b82b4a079d045fe8aba64888" candidate_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0500332e174645bfb46d0877f6ac40" is_pre_election: true
I20260810 04:14:25.303355 27633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391773f9b82b4a079d045fe8aba64888" candidate_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca00073dda214dac803f01bb1785d61c" is_pre_election: true
I20260810 04:14:25.303494 27773 raft_consensus.cc:2454] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386a9742afdb4c9080ac85c9a2c6f2e2 in term 0.
I20260810 04:14:25.303515 27633 raft_consensus.cc:2454] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386a9742afdb4c9080ac85c9a2c6f2e2 in term 0.
I20260810 04:14:25.303723 27842 leader_election.cc:302] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a9742afdb4c9080ac85c9a2c6f2e2, fc0500332e174645bfb46d0877f6ac40; no voters:
I20260810 04:14:25.303841 27982 raft_consensus.cc:2781] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:14:25.303892 27982 raft_consensus.cc:482] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:14:25.303921 27982 raft_consensus.cc:3037] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:25.304656 27982 raft_consensus.cc:504] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.304793 27982 leader_election.cc:288] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [CANDIDATE]: Term 1 election: Requested vote from peers ca00073dda214dac803f01bb1785d61c (127.10.249.129:37181), fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319)
I20260810 04:14:25.304944 27633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391773f9b82b4a079d045fe8aba64888" candidate_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca00073dda214dac803f01bb1785d61c"
I20260810 04:14:25.304979 27773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391773f9b82b4a079d045fe8aba64888" candidate_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0500332e174645bfb46d0877f6ac40"
I20260810 04:14:25.305043 27773 raft_consensus.cc:3037] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:25.305047 27633 raft_consensus.cc:3037] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:25.305802 27633 raft_consensus.cc:2454] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386a9742afdb4c9080ac85c9a2c6f2e2 in term 1.
I20260810 04:14:25.305827 27773 raft_consensus.cc:2454] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386a9742afdb4c9080ac85c9a2c6f2e2 in term 1.
I20260810 04:14:25.305987 27845 leader_election.cc:302] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a9742afdb4c9080ac85c9a2c6f2e2, ca00073dda214dac803f01bb1785d61c; no voters:
I20260810 04:14:25.306094 27982 raft_consensus.cc:2781] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:14:25.306257 27982 raft_consensus.cc:686] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 LEADER]: Becoming Leader. State: Replica: 386a9742afdb4c9080ac85c9a2c6f2e2, State: Running, Role: LEADER
I20260810 04:14:25.306361 27982 consensus_queue.cc:237] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:25.307125 27476 catalog_manager.cc:5495] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131). New cstate: current_term: 1 leader_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } health_report { overall_health: HEALTHY } } }
I20260810 04:14:25.320997 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.318990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50668 (local address 127.10.249.131:38739)
0810 04:14:25.319048 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:25.319050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:25.319059 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:25.319133 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:25.319134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:25.319160 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:25.319226 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:14:25.319325 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.319715 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.320385 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:25.320549 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:25.320594 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:25.320713 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:14:25.320799 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:14:25.320855 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:25.320885 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 04:14:25.320899 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:14:25.322573 27633 raft_consensus.cc:1261] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Refusing update from remote peer 386a9742afdb4c9080ac85c9a2c6f2e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:25.322585 27773 raft_consensus.cc:1261] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 1 FOLLOWER]: Refusing update from remote peer 386a9742afdb4c9080ac85c9a2c6f2e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:25.322871 27982 consensus_queue.cc:1035] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:25.322991 27984 consensus_queue.cc:1035] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:25.325129 27987 mvcc.cc:205] Tried to move back new op lower bound from 7316829246759071744 to 7316829246695559168. Current Snapshot: MvccSnapshot[applied={T|T < 7316829246759071744}]
I20260810 04:14:25.325421 27988 mvcc.cc:205] Tried to move back new op lower bound from 7316829246759071744 to 7316829246695559168. Current Snapshot: MvccSnapshot[applied={T|T < 7316829246759071744}]
I20260810 04:14:25.325613 27989 mvcc.cc:205] Tried to move back new op lower bound from 7316829246759071744 to 7316829246695559168. Current Snapshot: MvccSnapshot[applied={T|T < 7316829246759071744}]
I20260810 04:14:25.327553 27476 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:14:25.327636 27476 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:14:25.328344 27476 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Sending DeleteTablet for 3 replicas of tablet 391773f9b82b4a079d045fe8aba64888
I20260810 04:14:25.328681 27752 tablet_service.cc:1514] Processing DeleteTablet for tablet 391773f9b82b4a079d045fe8aba64888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:25 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:37654
I20260810 04:14:25.328691 27611 tablet_service.cc:1514] Processing DeleteTablet for tablet 391773f9b82b4a079d045fe8aba64888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:25 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:54978
I20260810 04:14:25.328730 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 27543
I20260810 04:14:25.329478 27891 tablet_service.cc:1514] Processing DeleteTablet for tablet 391773f9b82b4a079d045fe8aba64888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:25 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:50656
I20260810 04:14:25.330708 27999 tablet_replica.cc:330] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: stopping tablet replica
I20260810 04:14:25.330804 27999 raft_consensus.cc:2229] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:14:25.330917 27999 raft_consensus.cc:2258] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:25.331334 27999 ts_tablet_manager.cc:1905] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:14:25.332829 27998 tablet_replica.cc:330] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: stopping tablet replica
I20260810 04:14:25.332934 27998 raft_consensus.cc:2229] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:14:25.333032 27998 raft_consensus.cc:2258] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:25.333186 27999 ts_tablet_manager.cc:1918] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:25.333253 27999 log.cc:1196] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/391773f9b82b4a079d045fe8aba64888
I20260810 04:14:25.333557 27999 ts_tablet_manager.cc:1939] T 391773f9b82b4a079d045fe8aba64888 P 386a9742afdb4c9080ac85c9a2c6f2e2: Deleting consensus metadata
I20260810 04:14:25.334126 27998 ts_tablet_manager.cc:1905] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:14:25.334306 27461 catalog_manager.cc:4841] TS 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739): tablet 391773f9b82b4a079d045fe8aba64888 (table test-table [id=e8e936f98fb74534bbd79f2b8844f597]) successfully deleted
I20260810 04:14:25.335798 27998 ts_tablet_manager.cc:1918] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:25.335876 27998 log.cc:1196] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/391773f9b82b4a079d045fe8aba64888
I20260810 04:14:25.336193 27998 ts_tablet_manager.cc:1939] T 391773f9b82b4a079d045fe8aba64888 P fc0500332e174645bfb46d0877f6ac40: Deleting consensus metadata
W20260810 04:14:25.336449 27463 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:37181 (error 108)
I20260810 04:14:25.336639 27460 catalog_manager.cc:4841] TS fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319): tablet 391773f9b82b4a079d045fe8aba64888 (table test-table [id=e8e936f98fb74534bbd79f2b8844f597]) successfully deleted
I20260810 04:14:25.336874 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 27687
I20260810 04:14:25.336988 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:25.336826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37181 (local address 127.0.0.1:54994)
0810 04:14:25.336897 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:25.336944 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:37181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 04:14:25.337824 27463 catalog_manager.cc:4584] TS ca00073dda214dac803f01bb1785d61c (127.10.249.129:37181): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 391773f9b82b4a079d045fe8aba64888: Network error: Client connection negotiation failed: client connection to 127.10.249.129:37181: connect: Connection refused (error 111)
I20260810 04:14:25.342741 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 27825
I20260810 04:14:25.348116 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 27443
I20260810 04:14:45.353458 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38601
--webserver_interface=127.10.249.190
--webserver_port=35403
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:38601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:14:45.465772 28001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:45.466018 28001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:45.466045 28001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:45.467320 28001 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 04:14:45.467362 28001 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 04:14:45.467375 28001 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 04:14:45.467386 28001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:14:45.467397 28001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:45.467409 28001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:45.467420 28001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:14:45.467432 28001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:14:45.468945 28001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:38601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=35403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:45.469244 28001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:45.469475 28001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:45.479905 28012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:45.479910 28009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:45.479910 28010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:45.480290 28001 server_base.cc:1034] running on GCE node
I20260810 04:14:45.480594 28001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:45.480909 28001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:45.482074 28001 hybrid_clock.cc:648] HybridClock initialized: now 1786335285482054 us; error 36 us; skew 500 ppm
Aug 10 04:14:45 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:45.490468 28001 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:14:45.490993 28001 webserver.cc:460] Webserver started at http://127.10.249.190:35403/ using document root <none> and password file <none>
I20260810 04:14:45.491290 28001 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:45.491349 28001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:45.492583 28001 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 04:14:45.493287 28020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:45.493465 28001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:14:45.493547 28001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "bad34d9b97534717ac7767e3f614b55e"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "8d6f2012da4ce306238e530137f8a870"
server_key_iv: "bc6cebc87fdf4025ad4ba215a6187a06"
server_key_version: "encryptionkey@0"
I20260810 04:14:45.493942 28001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:45.504285 28001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:45.506044 28001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:45.506202 28001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:45.511000 28001 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:38601
I20260810 04:14:45.511063 28075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:38601 every 8 connection(s)
I20260810 04:14:45.511410 28001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:14:45.513288 28076 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:14:45.513437 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 28001
I20260810 04:14:45.513723 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:37181
--local_ip_for_outbound_sockets=127.10.249.129
--tserver_master_addrs=127.10.249.190:38601
--webserver_port=33953
--webserver_interface=127.10.249.129
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:45.514591 28076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Bootstrap starting.
I20260810 04:14:45.523888 28076 log.cc:824] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:45.525676 28076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:14:45.526052 28076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Bootstrap complete.
I20260810 04:14:45.528353 28076 raft_consensus.cc:348] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:14:45.528540 28076 raft_consensus.cc:729] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad34d9b97534717ac7767e3f614b55e, State: Initialized, Role: FOLLOWER
I20260810 04:14:45.528681 28076 consensus_queue.cc:260] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:14:45.528735 28076 raft_consensus.cc:388] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:14:45.528781 28076 raft_consensus.cc:482] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:14:45.528831 28076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:14:45.529748 28076 raft_consensus.cc:504] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:14:45.529913 28076 leader_election.cc:302] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bad34d9b97534717ac7767e3f614b55e; no voters:
I20260810 04:14:45.530078 28076 leader_election.cc:288] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 04:14:45.530108 28080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:14:45.530239 28080 raft_consensus.cc:686] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 2 LEADER]: Becoming Leader. State: Replica: bad34d9b97534717ac7767e3f614b55e, State: Running, Role: LEADER
I20260810 04:14:45.530369 28076 sys_catalog.cc:564] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:14:45.530396 28080 consensus_queue.cc:237] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:14:45.530854 28083 sys_catalog.cc:455] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bad34d9b97534717ac7767e3f614b55e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } } }
I20260810 04:14:45.530934 28083 sys_catalog.cc:458] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:45.531258 28089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:14:45.531308 28085 sys_catalog.cc:455] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bad34d9b97534717ac7767e3f614b55e. Latest consensus state: current_term: 2 leader_uuid: "bad34d9b97534717ac7767e3f614b55e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } } }
I20260810 04:14:45.531420 28085 sys_catalog.cc:458] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: This master's current role is: LEADER
I20260810 04:14:45.531980 28089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:14:45.532137 28089 catalog_manager.cc:1259] Loaded cluster ID: 8a3df3ddfa0442ce8d0e9455444a6d47
I20260810 04:14:45.532384 28089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:14:45.533430 28089 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:14:45.533617 28089 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Loaded TSK: 0
I20260810 04:14:45.542585 28089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Generated new TSK 1
I20260810 04:14:45.542649 28089 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:14:45.599653 28078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:45.599918 28078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:45.599956 28078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:45.601207 28078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:45.601287 28078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:45.601332 28078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:14:45.602777 28078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:37181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=33953
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:45.603004 28078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:45.603214 28078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:45.608779 28108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:45.608793 28111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:45.608827 28109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:45.609123 28078 server_base.cc:1034] running on GCE node
I20260810 04:14:45.609324 28078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:45.609596 28078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:45.610745 28078 hybrid_clock.cc:648] HybridClock initialized: now 1786335285610724 us; error 37 us; skew 500 ppm
Aug 10 04:14:45 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:45.613034 28078 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:14:45.613466 28078 webserver.cc:460] Webserver started at http://127.10.249.129:33953/ using document root <none> and password file <none>
I20260810 04:14:45.613705 28078 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:45.613758 28078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:45.615079 28078 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:45.615789 28119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:45.616030 28078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:45.616137 28078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "ca00073dda214dac803f01bb1785d61c"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "66a9ded456693964067e03c2e1fec816"
server_key_iv: "fedaa1bcd2949209c89413a57eb0963d"
server_key_version: "encryptionkey@0"
I20260810 04:14:45.616490 28078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:45.631918 28078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:45.634145 28078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:45.634296 28078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:45.634550 28078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:45.635097 28127 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:14:45.636595 28078 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:14:45.636646 28078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 04:14:45.636680 28078 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:14:45.637341 28078 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:14:45.637383 28078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 04:14:45.637424 28127 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Bootstrap starting.
I20260810 04:14:45.646457 28078 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:37181
I20260810 04:14:45.646974 28078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:14:45.647531 28241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:37181 every 8 connection(s)
I20260810 04:14:45.649888 28127 log.cc:824] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:45.650727 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 28078
I20260810 04:14:45.651081 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:46319
--local_ip_for_outbound_sockets=127.10.249.130
--tserver_master_addrs=127.10.249.190:38601
--webserver_port=40769
--webserver_interface=127.10.249.130
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:14:45.652467 28127 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:14:45.652818 28127 tablet_bootstrap.cc:492] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Bootstrap complete.
I20260810 04:14:45.654134 28127 ts_tablet_manager.cc:1397] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.010s
I20260810 04:14:45.655601 28127 raft_consensus.cc:348] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:45.655994 28127 raft_consensus.cc:729] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca00073dda214dac803f01bb1785d61c, State: Initialized, Role: FOLLOWER
I20260810 04:14:45.656172 28127 consensus_queue.cc:260] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } } peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } }
I20260810 04:14:45.656447 28127 ts_tablet_manager.cc:1428] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
Aug 10 04:14:45 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:45.662082 28245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.647838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:55251 (local address 127.10.249.190:38601)
0810 04:14:45.650048 (+ 2210us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:45.650057 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:45.650096 (+ 39us) server_negotiation.cc:407] Connection header received
0810 04:14:45.650220 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:45.650226 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:45.650277 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:45.650430 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:45.651267 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.652601 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.654311 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.654917 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.655025 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.657901 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:45.657906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:45.657906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:45.657918 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:45.659990 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:45.660552 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:45.660555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:45.660556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:45.660670 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:45.660984 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:45.660985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:45.660985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:45.661245 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:45.661321 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:45.661730 (+ 409us) server_negotiation.cc:299] Negotiation successful
0810 04:14:45.661890 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2160,"thread_start_us":70,"threads_started":1}
I20260810 04:14:45.662135 28244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.647729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:55251)
0810 04:14:45.647903 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:45.647947 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:45.648498 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:45.650474 (+ 1976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:45.650479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:45.650852 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:45.651124 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.651131 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.652751 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.652752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.654201 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.654205 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.655146 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.655147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.655273 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.655879 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:45.655890 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:45.657757 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:45.660087 (+ 2330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:45.660095 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:45.660098 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:45.660441 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:45.660742 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:45.660743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:45.660744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:45.660898 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:45.661319 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:45.661328 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:45.661517 (+ 189us) client_negotiation.cc:769] Sending connection context
0810 04:14:45.661673 (+ 156us) client_negotiation.cc:240] Negotiation successful
0810 04:14:45.661890 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260810 04:14:45.663254 28242 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38601
I20260810 04:14:45.663335 28242 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:45.663482 28242 heartbeater.cc:511] Master 127.10.249.190:38601 requested a full tablet report, sending...
I20260810 04:14:45.664168 28037 ts_manager.cc:194] Registered new tserver with Master: ca00073dda214dac803f01bb1785d61c (127.10.249.129:37181)
I20260810 04:14:45.665268 28037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:55251
I20260810 04:14:45.666337 28242 heartbeater.cc:503] Master 127.10.249.190:38601 was elected leader, sending a full tablet report...
I20260810 04:14:45.671522 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.664804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37181 (local address 127.0.0.1:48582)
0810 04:14:45.668064 (+ 3260us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:45.668092 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:45.668157 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:45.668372 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:45.668374 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:45.668375 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:45.668422 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.668424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.669594 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.669594 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.670406 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.670408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.671308 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.671309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.671367 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.671377 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 04:14:45.671426 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 04:14:45.671462 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3239,"thread_start_us":88,"threads_started":1}
I20260810 04:14:45.671571 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.665574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48582 (local address 127.10.249.129:37181)
0810 04:14:45.665838 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:45.665842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:45.668162 (+ 2320us) server_negotiation.cc:407] Connection header received
0810 04:14:45.668243 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:45.668246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:45.668262 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:45.668352 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:45.668500 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.669513 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.670480 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.671215 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.671294 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.671353 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:45.671457 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 04:14:45.671509 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":80,"threads_started":1}
I20260810 04:14:45.671963 28155 tablet_service.cc:1514] Processing DeleteTablet for tablet 391773f9b82b4a079d045fe8aba64888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:25 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:48582
I20260810 04:14:45.672479 28252 tablet_replica.cc:330] stopping tablet replica
I20260810 04:14:45.672595 28252 raft_consensus.cc:2229] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:14:45.672677 28252 raft_consensus.cc:2258] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:45.672967 28252 ts_tablet_manager.cc:1905] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:14:45.675321 28252 ts_tablet_manager.cc:1918] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:45.675400 28252 log.cc:1196] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal/wals/391773f9b82b4a079d045fe8aba64888
I20260810 04:14:45.675652 28252 ts_tablet_manager.cc:1939] T 391773f9b82b4a079d045fe8aba64888 P ca00073dda214dac803f01bb1785d61c: Deleting consensus metadata
I20260810 04:14:45.676163 28024 catalog_manager.cc:4841] TS ca00073dda214dac803f01bb1785d61c (127.10.249.129:37181): tablet 391773f9b82b4a079d045fe8aba64888 (table test-table [id=e8e936f98fb74534bbd79f2b8844f597]) successfully deleted
W20260810 04:14:45.737725 28248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:45.737972 28248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:45.737994 28248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:45.739097 28248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:45.739131 28248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:45.739156 28248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:14:45.740506 28248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:46319
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=40769
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:45.740682 28248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:45.740849 28248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:45.745759 28257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:45.745831 28248 server_base.cc:1034] running on GCE node
W20260810 04:14:45.745780 28258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:45.745833 28261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:45.746361 28248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:45.746639 28248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:45.747815 28248 hybrid_clock.cc:648] HybridClock initialized: now 1786335285747804 us; error 28 us; skew 500 ppm
Aug 10 04:14:45 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:45.750644 28248 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:14:45.751151 28248 webserver.cc:460] Webserver started at http://127.10.249.130:40769/ using document root <none> and password file <none>
I20260810 04:14:45.751343 28248 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:45.751401 28248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:45.752708 28248 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:14:45.753290 28268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:45.753470 28248 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:14:45.753579 28248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "fc0500332e174645bfb46d0877f6ac40"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "93562e5a4699b06b5dc40bf34cb223be"
server_key_iv: "94a13cf35f6e2115d3089aafc9312705"
server_key_version: "encryptionkey@0"
I20260810 04:14:45.753974 28248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:45.766439 28248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:45.768800 28248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:45.768965 28248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:45.769205 28248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:45.769528 28248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:45.769567 28248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:45.769613 28248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:45.769644 28248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:45.776889 28248 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:46319
I20260810 04:14:45.776925 28390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:46319 every 8 connection(s)
I20260810 04:14:45.777330 28248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:14:45.780172 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 28248
I20260810 04:14:45.780532 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:38739
--local_ip_for_outbound_sockets=127.10.249.131
--tserver_master_addrs=127.10.249.190:38601
--webserver_port=33983
--webserver_interface=127.10.249.131
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:14:45 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:45.787619 28245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.778151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:39573 (local address 127.10.249.190:38601)
0810 04:14:45.778210 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:45.778212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:45.778392 (+ 180us) server_negotiation.cc:407] Connection header received
0810 04:14:45.778826 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:45.778828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:45.778841 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:45.778904 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:45.779915 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.780719 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.781746 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.782136 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.782213 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.784640 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:45.784642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:45.784642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:45.784655 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:45.786098 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:45.786633 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:45.786634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:45.786634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:45.786690 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:45.786991 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:45.786991 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:45.786992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:45.787088 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:45.787137 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:45.787487 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 04:14:45.787555 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:14:45.788031 28393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.778127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:39573)
0810 04:14:45.778278 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:45.778311 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:45.778745 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:45.778956 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:45.778959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:45.779610 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:45.779802 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.779807 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.780814 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.780816 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.781639 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.781641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.782228 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.782228 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.782386 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.782867 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:45.782877 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:45.784543 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:45.786179 (+ 1636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:45.786188 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:45.786190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:45.786550 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:45.786758 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:45.786759 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:45.786760 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:45.786918 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:45.787155 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:45.787163 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:45.787339 (+ 176us) client_negotiation.cc:769] Sending connection context
0810 04:14:45.787476 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 04:14:45.787676 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":89,"threads_started":1}
I20260810 04:14:45.788646 28391 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38601
I20260810 04:14:45.788755 28391 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:45.788940 28391 heartbeater.cc:511] Master 127.10.249.190:38601 requested a full tablet report, sending...
I20260810 04:14:45.789382 28037 ts_manager.cc:194] Registered new tserver with Master: fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319)
I20260810 04:14:45.789767 28037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:39573
W20260810 04:14:45.868467 28394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:14:45.868701 28394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:14:45.868738 28394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:14:45.869854 28394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:14:45.869918 28394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:14:45.869962 28394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:14:45.871376 28394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:38739
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=33983
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:14:45.871618 28394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:14:45.871845 28394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:14:45.876847 28400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:14:45.876861 28399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:45.877030 28394 server_base.cc:1034] running on GCE node
W20260810 04:14:45.876847 28403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:14:45.877342 28394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:14:45.877578 28394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:14:45.878746 28394 hybrid_clock.cc:648] HybridClock initialized: now 1786335285878726 us; error 56 us; skew 500 ppm
Aug 10 04:14:45 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:14:45.881166 28394 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:14:45.881814 28394 webserver.cc:460] Webserver started at http://127.10.249.131:33983/ using document root <none> and password file <none>
I20260810 04:14:45.882062 28394 fs_manager.cc:359] Metadata directory not provided
I20260810 04:14:45.882141 28394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:14:45.883479 28394 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:14:45.884024 28410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:45.884195 28394 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:45.884276 28394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "386a9742afdb4c9080ac85c9a2c6f2e2"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "a58a8c5e717b40e880fd384653f55d14"
server_key_iv: "cdbf299d064ee72e2b6f3e2b3cc5c34c"
server_key_version: "encryptionkey@0"
I20260810 04:14:45.884588 28394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:14:45.896638 28394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:14:45.898790 28394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:14:45.898897 28394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:14:45.899151 28394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:14:45.899438 28394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:14:45.899469 28394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:45.899490 28394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:14:45.899502 28394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:14:45.905982 28394 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:38739
I20260810 04:14:45.906042 28527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:38739 every 8 connection(s)
I20260810 04:14:45.906433 28394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:14:45.907670 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 28394
Aug 10 04:14:45 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:14:45.915798 28534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.908112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47132 (local address 127.10.249.190:38601)
0810 04:14:45.908229 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:45.908231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:45.908500 (+ 269us) server_negotiation.cc:407] Connection header received
0810 04:14:45.908565 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:45.908565 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:45.908573 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:45.908621 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:45.909404 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.910105 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.911109 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.911309 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.911369 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.912861 (+ 1492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:45.912863 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:45.912863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:45.912869 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:45.914390 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:45.914880 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:45.914881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:45.914881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:45.914957 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:45.915181 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:45.915182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:45.915183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:45.915287 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:45.915473 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:45.915561 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 04:14:45.915690 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260810 04:14:45.917405 28245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.907244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:60939 (local address 127.10.249.190:38601)
0810 04:14:45.907307 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:45.907310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:45.907576 (+ 266us) server_negotiation.cc:407] Connection header received
0810 04:14:45.908343 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:45.908343 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:45.908353 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:45.908386 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:45.909687 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.910297 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.911578 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.911810 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.911872 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.914487 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:45.914488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:45.914489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:45.914497 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:45.916234 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:45.916668 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:45.916677 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:45.916677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:45.916727 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:45.916936 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:45.916936 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:45.916937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:45.917042 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:45.917089 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:45.917291 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 04:14:45.917349 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:14:45.917572 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.907238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:60939)
0810 04:14:45.907397 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:45.907465 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:45.908215 (+ 750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:45.908532 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:45.908536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:45.909360 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:14:45.909595 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.909600 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.910373 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.910374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.911502 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.911505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.911890 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.911891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.912044 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.912464 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:14:45.912476 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:14:45.914270 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:14:45.916303 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:45.916309 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:45.916311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:45.916597 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:45.916787 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:14:45.916788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:14:45.916788 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:14:45.916882 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:14:45.917081 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:14:45.917084 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:14:45.917192 (+ 108us) client_negotiation.cc:769] Sending connection context
0810 04:14:45.917265 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:14:45.917373 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260810 04:14:45.918042 28528 heartbeater.cc:347] Connected to a master server at 127.10.249.190:38601
I20260810 04:14:45.918135 28528 heartbeater.cc:464] Registering TS with master...
I20260810 04:14:45.918344 28528 heartbeater.cc:511] Master 127.10.249.190:38601 requested a full tablet report, sending...
I20260810 04:14:45.918682 28037 ts_manager.cc:194] Registered new tserver with Master: 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
I20260810 04:14:45.919039 28037 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:60939
I20260810 04:14:45.927388 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:14:45.930430 28245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.927761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.10.249.190:38601)
0810 04:14:45.927860 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:45.927862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:45.927965 (+ 103us) server_negotiation.cc:407] Connection header received
0810 04:14:45.928062 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:45.928063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:45.928118 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:45.928208 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:14:45.928347 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.928831 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.929582 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.929832 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.929890 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.930092 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:14:45.930211 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:14:45.930311 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:45.930330 (+ 19us) server_negotiation.cc:299] Negotiation successful
0810 04:14:45.930351 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 04:14:45.930817 28037 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:14:45.932693 28037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:14:45.935191 28155 tablet_service.cc:1467] Processing CreateTablet for tablet 679145365f914ad3bf387b37db98bebf (DEFAULT_TABLE table=test-table [id=fa9aeadb598248dea6e6d5d0c6b21f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:45.935426 28155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679145365f914ad3bf387b37db98bebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:45.936703 28127 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Bootstrap starting.
I20260810 04:14:45.937029 28127 tablet_bootstrap.cc:654] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:45.937615 28127 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: No bootstrap required, opened a new log
I20260810 04:14:45.937667 28127 ts_tablet_manager.cc:1397] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260810 04:14:45.937778 28127 raft_consensus.cc:348] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:45.937881 28127 raft_consensus.cc:374] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:45.937951 28127 raft_consensus.cc:729] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca00073dda214dac803f01bb1785d61c, State: Initialized, Role: FOLLOWER
I20260810 04:14:45.937999 28127 consensus_queue.cc:260] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:45.938100 28127 ts_tablet_manager.cc:1428] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:14:45.939011 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.934739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46319 (local address 127.0.0.1:45728)
0810 04:14:45.934788 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:45.934800 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:45.934836 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:45.935280 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:45.935281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:45.935283 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:45.935330 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.935332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.936650 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.936651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.937814 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.937817 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.938784 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.938784 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.938843 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.938847 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:14:45.938898 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 04:14:45.938942 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 04:14:45.939038 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.934845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45728 (local address 127.10.249.130:46319)
0810 04:14:45.935053 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:45.935059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:45.935069 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:14:45.935114 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:45.935119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:45.935164 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:45.935256 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:45.935432 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.936545 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.937923 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.938696 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.938785 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.938851 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:45.938917 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 04:14:45.938961 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":91,"threads_started":1}
I20260810 04:14:45.939224 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.934774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38739 (local address 127.0.0.1:43070)
0810 04:14:45.934947 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:45.934957 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:45.934999 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:45.935447 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:45.935448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:45.935450 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:45.935486 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.935488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.937034 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.937035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.938139 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:45.938141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.938972 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.938973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:45.939038 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.939042 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:14:45.939093 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 04:14:45.939155 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":122,"threads_started":1}
I20260810 04:14:45.939458 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:45.935036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43070 (local address 127.10.249.131:38739)
0810 04:14:45.935241 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:45.935246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:45.935255 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:14:45.935330 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:45.935332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:45.935370 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:45.935449 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:45.935557 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.936906 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.938229 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:45.938872 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:45.938969 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:45.939020 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:45.939327 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 04:14:45.939370 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":105,"threads_started":1}
I20260810 04:14:45.939838 28318 tablet_service.cc:1467] Processing CreateTablet for tablet 679145365f914ad3bf387b37db98bebf (DEFAULT_TABLE table=test-table [id=fa9aeadb598248dea6e6d5d0c6b21f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:45.940135 28318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679145365f914ad3bf387b37db98bebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:45.940168 28460 tablet_service.cc:1467] Processing CreateTablet for tablet 679145365f914ad3bf387b37db98bebf (DEFAULT_TABLE table=test-table [id=fa9aeadb598248dea6e6d5d0c6b21f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:14:45.940521 28460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679145365f914ad3bf387b37db98bebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:14:45.943001 28540 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Bootstrap starting.
I20260810 04:14:45.943387 28541 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: Bootstrap starting.
I20260810 04:14:45.943717 28540 tablet_bootstrap.cc:654] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:45.944072 28541 tablet_bootstrap.cc:654] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: Neither blocks nor log segments found. Creating new log.
I20260810 04:14:45.944270 28540 log.cc:824] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:45.944638 28541 log.cc:824] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: Log is configured to *not* fsync() on all Append() calls
I20260810 04:14:45.945030 28540 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: No bootstrap required, opened a new log
I20260810 04:14:45.945111 28540 ts_tablet_manager.cc:1397] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:14:45.945369 28541 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: No bootstrap required, opened a new log
I20260810 04:14:45.945431 28541 ts_tablet_manager.cc:1397] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:14:45.946848 28540 raft_consensus.cc:348] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:45.947006 28540 raft_consensus.cc:374] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:45.947053 28540 raft_consensus.cc:729] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0500332e174645bfb46d0877f6ac40, State: Initialized, Role: FOLLOWER
I20260810 04:14:45.947175 28540 consensus_queue.cc:260] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:45.947113 28541 raft_consensus.cc:348] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:45.947278 28541 raft_consensus.cc:374] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:14:45.947337 28541 raft_consensus.cc:729] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386a9742afdb4c9080ac85c9a2c6f2e2, State: Initialized, Role: FOLLOWER
I20260810 04:14:45.947465 28541 consensus_queue.cc:260] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:45.947520 28540 ts_tablet_manager.cc:1428] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:14:45.947532 28391 heartbeater.cc:503] Master 127.10.249.190:38601 was elected leader, sending a full tablet report...
I20260810 04:14:45.947751 28541 ts_tablet_manager.cc:1428] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:14:45.947803 28528 heartbeater.cc:503] Master 127.10.249.190:38601 was elected leader, sending a full tablet report...
W20260810 04:14:46.027942 28392 tablet.cc:2369] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:14:46.033375 28249 raft_consensus.cc:482] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:14:46.033509 28249 raft_consensus.cc:504] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:46.033918 28249 leader_election.cc:288] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319), 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
I20260810 04:14:46.036744 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:46.034150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:60035 (local address 127.10.249.131:38739)
0810 04:14:46.034207 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:46.034209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:46.034221 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:14:46.034283 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:46.034283 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:46.034293 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:46.034368 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:46.034628 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.035066 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.036002 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.036392 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.036477 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:46.036486 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:46.036631 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 04:14:46.036671 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:14:46.036751 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:46.034160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:50883 (local address 127.10.249.130:46319)
0810 04:14:46.034214 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:46.034215 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:46.034375 (+ 160us) server_negotiation.cc:407] Connection header received
0810 04:14:46.034403 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:46.034404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:46.034413 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:46.034453 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:14:46.034613 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.035066 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.035994 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.036365 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.036460 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:46.036471 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:46.036630 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 04:14:46.036674 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:14:46.036754 28244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:46.034093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38739 (local address 127.10.249.129:60035)
0810 04:14:46.034166 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:46.034179 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:46.034221 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:46.034497 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:46.034497 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:46.034499 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:46.034550 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:46.034552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.035150 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.035151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:46.035884 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:46.035886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.036488 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.036489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:46.036559 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:46.036562 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:14:46.036626 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:14:46.036686 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":2}
I20260810 04:14:46.036824 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:46.034095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46319 (local address 127.10.249.129:50883)
0810 04:14:46.034289 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:46.034300 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:14:46.034359 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:14:46.034479 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:14:46.034480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:14:46.034481 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:14:46.034538 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:46.034540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.035153 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.035154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:46.035885 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:14:46.035887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.036482 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.036484 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:14:46.036555 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:46.036559 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:14:46.036625 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:14:46.036673 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":13,"thread_start_us":114,"threads_started":1}
I20260810 04:14:46.037251 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679145365f914ad3bf387b37db98bebf" candidate_uuid: "ca00073dda214dac803f01bb1785d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0500332e174645bfb46d0877f6ac40" is_pre_election: true
I20260810 04:14:46.037389 28340 raft_consensus.cc:2454] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca00073dda214dac803f01bb1785d61c in term 0.
I20260810 04:14:46.037344 28482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679145365f914ad3bf387b37db98bebf" candidate_uuid: "ca00073dda214dac803f01bb1785d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" is_pre_election: true
I20260810 04:14:46.037497 28482 raft_consensus.cc:2454] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca00073dda214dac803f01bb1785d61c in term 0.
I20260810 04:14:46.037600 28120 leader_election.cc:302] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca00073dda214dac803f01bb1785d61c, fc0500332e174645bfb46d0877f6ac40; no voters:
I20260810 04:14:46.037709 28249 raft_consensus.cc:2781] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:14:46.037763 28249 raft_consensus.cc:482] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:14:46.037817 28249 raft_consensus.cc:3037] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:46.038497 28249 raft_consensus.cc:504] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:46.038633 28249 leader_election.cc:288] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 1 election: Requested vote from peers fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319), 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
I20260810 04:14:46.038781 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679145365f914ad3bf387b37db98bebf" candidate_uuid: "ca00073dda214dac803f01bb1785d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0500332e174645bfb46d0877f6ac40"
I20260810 04:14:46.038796 28482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679145365f914ad3bf387b37db98bebf" candidate_uuid: "ca00073dda214dac803f01bb1785d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2"
I20260810 04:14:46.038848 28340 raft_consensus.cc:3037] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:46.038865 28482 raft_consensus.cc:3037] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:14:46.039523 28340 raft_consensus.cc:2454] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca00073dda214dac803f01bb1785d61c in term 1.
I20260810 04:14:46.039613 28482 raft_consensus.cc:2454] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca00073dda214dac803f01bb1785d61c in term 1.
I20260810 04:14:46.039659 28120 leader_election.cc:302] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca00073dda214dac803f01bb1785d61c, fc0500332e174645bfb46d0877f6ac40; no voters:
I20260810 04:14:46.039732 28249 raft_consensus.cc:2781] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:14:46.039916 28249 raft_consensus.cc:686] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 LEADER]: Becoming Leader. State: Replica: ca00073dda214dac803f01bb1785d61c, State: Running, Role: LEADER
I20260810 04:14:46.039987 28249 consensus_queue.cc:237] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:14:46.040814 28037 catalog_manager.cc:5495] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to ca00073dda214dac803f01bb1785d61c (127.10.249.129). New cstate: current_term: 1 leader_uuid: "ca00073dda214dac803f01bb1785d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } health_report { overall_health: HEALTHY } } }
I20260810 04:14:46.052533 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:46.050814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48590 (local address 127.10.249.129:37181)
0810 04:14:46.050848 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:46.050850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:46.050858 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:14:46.050906 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:46.050906 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:46.050920 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:46.050975 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:14:46.051077 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.051464 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.052050 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.052218 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.052260 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:46.052367 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:14:46.052406 (+ 39us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 04:14:46.052497 (+ 91us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48590: token expired
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 04:14:46.052593 28251 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48590: token expired
I20260810 04:14:46.058197 28245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:46.052878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47152 (local address 127.10.249.190:38601)
0810 04:14:46.052934 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:46.052936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:46.052944 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:14:46.052962 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:46.052963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:46.052971 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:46.053034 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:14:46.053483 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.053964 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.054563 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.054740 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.054806 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:46.055771 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:14:46.055773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:14:46.055773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:14:46.055780 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:14:46.057048 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:46.057392 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:46.057393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:46.057393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:46.057449 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:14:46.057650 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:14:46.057651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:14:46.057651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:14:46.057843 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:14:46.057930 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:46.058022 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 04:14:46.058098 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:14:46.060598 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:46.058918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.10.249.129:37181)
0810 04:14:46.058953 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:14:46.058954 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:14:46.058962 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:14:46.058987 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:14:46.058988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:14:46.059014 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:14:46.059057 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:14:46.059131 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.059495 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.060078 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:14:46.060243 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:14:46.060289 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:14:46.060393 (+ 104us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:14:46.060460 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:14:46.060497 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 04:14:46.060545 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 04:14:46.060559 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:14:46.061944 28482 raft_consensus.cc:1261] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 FOLLOWER]: Refusing update from remote peer ca00073dda214dac803f01bb1785d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:46.061944 28340 raft_consensus.cc:1261] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 1 FOLLOWER]: Refusing update from remote peer ca00073dda214dac803f01bb1785d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:14:46.062222 28249 consensus_queue.cc:1035] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:46.062337 28547 consensus_queue.cc:1035] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:14:46.066665 28036 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:14:46.066756 28036 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:14:46.067451 28036 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Sending DeleteTablet for 3 replicas of tablet 679145365f914ad3bf387b37db98bebf
I20260810 04:14:46.067727 28318 tablet_service.cc:1514] Processing DeleteTablet for tablet 679145365f914ad3bf387b37db98bebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:46 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:45728
I20260810 04:14:46.067763 28155 tablet_service.cc:1514] Processing DeleteTablet for tablet 679145365f914ad3bf387b37db98bebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:46 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:48582
I20260810 04:14:46.067763 28460 tablet_service.cc:1514] Processing DeleteTablet for tablet 679145365f914ad3bf387b37db98bebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:14:46 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:43070
I20260810 04:14:46.067842 28252 tablet_replica.cc:330] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: stopping tablet replica
I20260810 04:14:46.067884 28252 raft_consensus.cc:2229] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:14:46.067979 28252 raft_consensus.cc:2258] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:46.068025 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 28078
I20260810 04:14:46.068140 28561 tablet_replica.cc:330] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: stopping tablet replica
I20260810 04:14:46.068807 28561 raft_consensus.cc:2229] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:14:46.068940 28561 raft_consensus.cc:2258] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:46.069106 28560 tablet_replica.cc:330] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: stopping tablet replica
I20260810 04:14:46.069218 28560 raft_consensus.cc:2229] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:14:46.069339 28560 raft_consensus.cc:2258] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:14:46.070544 28560 ts_tablet_manager.cc:1905] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:14:46.072283 28560 ts_tablet_manager.cc:1918] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:46.072366 28560 log.cc:1196] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/679145365f914ad3bf387b37db98bebf
I20260810 04:14:46.072621 28560 ts_tablet_manager.cc:1939] T 679145365f914ad3bf387b37db98bebf P fc0500332e174645bfb46d0877f6ac40: Deleting consensus metadata
I20260810 04:14:46.073117 28021 catalog_manager.cc:4841] TS fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319): tablet 679145365f914ad3bf387b37db98bebf (table test-table [id=fa9aeadb598248dea6e6d5d0c6b21f83]) successfully deleted
W20260810 04:14:46.075191 28024 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:37181 (error 108)
I20260810 04:14:46.075438 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 28248
I20260810 04:14:46.077210 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:14:46.075655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37181 (local address 127.0.0.1:48608)
0810 04:14:46.077122 (+ 1467us) negotiation.cc:107] Waiting for socket to connect
0810 04:14:46.077173 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:37181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1434}
I20260810 04:14:46.077477 28561 ts_tablet_manager.cc:1905] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 04:14:46.078387 28024 catalog_manager.cc:4584] TS ca00073dda214dac803f01bb1785d61c (127.10.249.129:37181): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 679145365f914ad3bf387b37db98bebf: Network error: Client connection negotiation failed: client connection to 127.10.249.129:37181: connect: Connection refused (error 111)
I20260810 04:14:46.078922 28561 ts_tablet_manager.cc:1918] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:14:46.078979 28561 log.cc:1196] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/679145365f914ad3bf387b37db98bebf
I20260810 04:14:46.079216 28561 ts_tablet_manager.cc:1939] T 679145365f914ad3bf387b37db98bebf P 386a9742afdb4c9080ac85c9a2c6f2e2: Deleting consensus metadata
I20260810 04:14:46.079591 28022 catalog_manager.cc:4841] TS 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739): tablet 679145365f914ad3bf387b37db98bebf (table test-table [id=fa9aeadb598248dea6e6d5d0c6b21f83]) successfully deleted
I20260810 04:14:46.082301 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 28394
I20260810 04:14:46.087805 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 28001
I20260810 04:15:06.094297 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38601
--webserver_interface=127.10.249.190
--webserver_port=35403
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:38601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:06.173897 28563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:06.174082 28563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:06.174103 28563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:06.175127 28563 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 04:15:06.175158 28563 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 04:15:06.175168 28563 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 04:15:06.175187 28563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:06.175199 28563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:06.175210 28563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:06.175225 28563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:06.175236 28563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:06.176707 28563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:38601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=35403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:06.176887 28563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:06.177038 28563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:15:06.182471 28563 server_base.cc:1034] running on GCE node
W20260810 04:15:06.182448 28568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:06.182427 28569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:06.182443 28572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:06.182919 28563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:06.183224 28563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:06.184368 28563 hybrid_clock.cc:648] HybridClock initialized: now 1786335306184349 us; error 35 us; skew 500 ppm
Aug 10 04:15:06 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335306, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:06.192940 28563 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:06.193396 28563 webserver.cc:460] Webserver started at http://127.10.249.190:35403/ using document root <none> and password file <none>
I20260810 04:15:06.193598 28563 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:06.193660 28563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:06.194983 28563 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:15:06.195622 28579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.195786 28563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:15:06.195885 28563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "bad34d9b97534717ac7767e3f614b55e"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "8d6f2012da4ce306238e530137f8a870"
server_key_iv: "bc6cebc87fdf4025ad4ba215a6187a06"
server_key_version: "encryptionkey@0"
I20260810 04:15:06.196216 28563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:06.216069 28563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:06.218324 28563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:06.218510 28563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:06.223026 28563 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:38601
I20260810 04:15:06.223061 28634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:38601 every 8 connection(s)
I20260810 04:15:06.223445 28563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:06.225021 28635 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:15:06.225697 28635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Bootstrap starting.
I20260810 04:15:06.230298 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 28563
I20260810 04:15:06.230597 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:37181
--local_ip_for_outbound_sockets=127.10.249.129
--tserver_master_addrs=127.10.249.190:38601
--webserver_port=33953
--webserver_interface=127.10.249.129
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:15:06.234608 28635 log.cc:824] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:06.236574 28635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:15:06.236882 28635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Bootstrap complete.
I20260810 04:15:06.239077 28635 raft_consensus.cc:348] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:15:06.239286 28635 raft_consensus.cc:729] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad34d9b97534717ac7767e3f614b55e, State: Initialized, Role: FOLLOWER
I20260810 04:15:06.239452 28635 consensus_queue.cc:260] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:15:06.239507 28635 raft_consensus.cc:388] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:06.239557 28635 raft_consensus.cc:482] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:06.239602 28635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 2 FOLLOWER]: Advancing to term 3
I20260810 04:15:06.240578 28635 raft_consensus.cc:504] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:15:06.240669 28635 leader_election.cc:302] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bad34d9b97534717ac7767e3f614b55e; no voters:
I20260810 04:15:06.240849 28635 leader_election.cc:288] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 04:15:06.240881 28639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 3 FOLLOWER]: Leader election won for term 3
I20260810 04:15:06.240993 28639 raft_consensus.cc:686] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [term 3 LEADER]: Becoming Leader. State: Replica: bad34d9b97534717ac7767e3f614b55e, State: Running, Role: LEADER
I20260810 04:15:06.241110 28635 sys_catalog.cc:564] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:06.241155 28639 consensus_queue.cc:237] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } }
I20260810 04:15:06.241549 28639 sys_catalog.cc:455] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bad34d9b97534717ac7767e3f614b55e. Latest consensus state: current_term: 3 leader_uuid: "bad34d9b97534717ac7767e3f614b55e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } } }
I20260810 04:15:06.241693 28639 sys_catalog.cc:458] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:06.241550 28640 sys_catalog.cc:455] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "bad34d9b97534717ac7767e3f614b55e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bad34d9b97534717ac7767e3f614b55e" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38601 } } }
I20260810 04:15:06.241972 28640 sys_catalog.cc:458] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:06.242107 28647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:06.242956 28647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:06.243048 28647 catalog_manager.cc:1259] Loaded cluster ID: 8a3df3ddfa0442ce8d0e9455444a6d47
I20260810 04:15:06.243070 28647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:06.244169 28647 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:06.244340 28647 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Loaded TSK: 0
I20260810 04:15:06.244379 28647 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bad34d9b97534717ac7767e3f614b55e: Loaded TSK: 1
F20260810 04:15:06.244580 28647 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f3c436599ad google::LogMessage::Fail() at ??:0
@ 0x7f3c4365c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f3c436594de google::LogMessage::Flush() at ??:0
@ 0x7f3c4365aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f3c45dc6104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f3c45dc3d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f3c4b5b71cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f3c4b5b748e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f3c4b5b7594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f3c4b57dc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f3c4b587ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f3c455270d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3c4551c954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f3c463806db start_thread at ??:0
@ 0x7f3c4215761f clone at ??:0
W20260810 04:15:06.325685 28637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:06.325959 28637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:06.325994 28637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:06.327009 28637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:06.327071 28637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:06.327113 28637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:15:06.328588 28637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:37181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=33953
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:06.328845 28637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:06.329063 28637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:15:06.333601 28637 server_base.cc:1034] running on GCE node
W20260810 04:15:06.333597 28680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:06.333737 28683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:06.333882 28679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:06.334095 28637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:06.334355 28637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:06.335510 28637 hybrid_clock.cc:648] HybridClock initialized: now 1786335306335493 us; error 34 us; skew 500 ppm
Aug 10 04:15:06 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335306, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:06.338049 28637 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:15:06.338563 28637 webserver.cc:460] Webserver started at http://127.10.249.129:33953/ using document root <none> and password file <none>
I20260810 04:15:06.338788 28637 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:06.338829 28637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:06.340090 28637 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:06.340765 28691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.340910 28637 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:06.341029 28637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "ca00073dda214dac803f01bb1785d61c"
format_stamp: "Formatted at 2026-08-10 04:14:24 on dist-test-slave-0kls"
server_key: "66a9ded456693964067e03c2e1fec816"
server_key_iv: "fedaa1bcd2949209c89413a57eb0963d"
server_key_version: "encryptionkey@0"
I20260810 04:15:06.341390 28637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:06.356921 28637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:06.359184 28637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:06.359321 28637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:06.359542 28637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:06.360023 28699 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:15:06.362092 28637 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:15:06.362141 28637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 04:15:06.362185 28637 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:15:06.363004 28637 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:15:06.363049 28637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 04:15:06.363138 28699 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Bootstrap starting.
I20260810 04:15:06.370550 28637 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:37181
I20260810 04:15:06.370702 28812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:37181 every 8 connection(s)
I20260810 04:15:06.371006 28637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:15:06.373085 28699 log.cc:824] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:06.375083 28699 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:15:06.375362 28699 tablet_bootstrap.cc:492] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Bootstrap complete.
I20260810 04:15:06.376201 28699 ts_tablet_manager.cc:1397] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.008s
I20260810 04:15:06.376535 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 28637
I20260810 04:15:06.376832 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:46319
--local_ip_for_outbound_sockets=127.10.249.130
--tserver_master_addrs=127.10.249.190:38601
--webserver_port=40769
--webserver_interface=127.10.249.130
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:15:06.377960 28699 raft_consensus.cc:348] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:15:06.378348 28699 raft_consensus.cc:729] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca00073dda214dac803f01bb1785d61c, State: Initialized, Role: FOLLOWER
I20260810 04:15:06.378523 28699 consensus_queue.cc:260] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:15:06.378854 28699 ts_tablet_manager.cc:1428] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
W20260810 04:15:06.443681 28816 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:06.371677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:39073)
0810 04:15:06.371895 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.371941 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:06.372470 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:06.443431 (+ 70961us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":113,"threads_started":1}
W20260810 04:15:06.443988 28813 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:38601 (0 consecutive failures): Network error: Failed to ping master at 127.10.249.190:38601: Client connection negotiation failed: client connection to 127.10.249.190:38601: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 04:15:06.444350 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:06.444230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:44631)
0810 04:15:06.444287 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.444324 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 04:15:06.444769 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:06.444681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:47259)
0810 04:15:06.444726 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.444749 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 04:15:06.444919 28813 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:15:06.459358 28818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:06.459563 28818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:06.459599 28818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:06.460755 28818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:06.460822 28818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:06.460868 28818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:15:06.462373 28818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:46319
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=40769
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:06.462636 28818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:06.462879 28818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:06.467852 28828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:06.467861 28827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:06.467924 28818 server_base.cc:1034] running on GCE node
W20260810 04:15:06.467864 28830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:06.468242 28818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:06.468519 28818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:06.469676 28818 hybrid_clock.cc:648] HybridClock initialized: now 1786335306469670 us; error 31 us; skew 500 ppm
Aug 10 04:15:06 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335306, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:06.471925 28818 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:15:06.472357 28818 webserver.cc:460] Webserver started at http://127.10.249.130:40769/ using document root <none> and password file <none>
I20260810 04:15:06.472584 28818 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:06.472645 28818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:06.473889 28818 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:06.474443 28837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.474596 28818 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:06.474689 28818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "fc0500332e174645bfb46d0877f6ac40"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "93562e5a4699b06b5dc40bf34cb223be"
server_key_iv: "94a13cf35f6e2115d3089aafc9312705"
server_key_version: "encryptionkey@0"
I20260810 04:15:06.475001 28818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:06.513607 28818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:06.515347 28818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:06.515493 28818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:06.515717 28818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:06.516004 28818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:06.516053 28818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.516085 28818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:06.516108 28818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.522294 28818 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:46319
I20260810 04:15:06.522339 28957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:46319 every 8 connection(s)
I20260810 04:15:06.522692 28818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:15:06.523452 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 28818
I20260810 04:15:06.523705 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:06.523347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:56003)
0810 04:15:06.523498 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.523569 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":88,"threads_started":1}
I20260810 04:15:06.523756 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:38739
--local_ip_for_outbound_sockets=127.10.249.131
--tserver_master_addrs=127.10.249.190:38601
--webserver_port=33983
--webserver_interface=127.10.249.131
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:06.524045 28958 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:38601 (0 consecutive failures): Network error: Failed to ping master at 127.10.249.190:38601: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
I20260810 04:15:06.524295 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:06.524210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:57819)
0810 04:15:06.524254 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.524280 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 04:15:06.524547 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:06.524470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:43457)
0810 04:15:06.524508 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.524527 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260810 04:15:06.524634 28958 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:15:06.599512 28962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:06.599722 28962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:06.599785 28962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:06.600919 28962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:06.600993 28962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:06.601044 28962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:15:06.602423 28962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:38739
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=33983
--tserver_master_addrs=127.10.249.190:38601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:06.602660 28962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:06.602870 28962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:06.607334 28968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:06.607333 28970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:06.607385 28972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:06.607630 28962 server_base.cc:1034] running on GCE node
I20260810 04:15:06.607824 28962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:06.608067 28962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:06.609218 28962 hybrid_clock.cc:648] HybridClock initialized: now 1786335306609207 us; error 48 us; skew 500 ppm
Aug 10 04:15:06 dist-test-slave-0kls krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335306, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:06.611315 28962 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:15:06.611699 28962 webserver.cc:460] Webserver started at http://127.10.249.131:33983/ using document root <none> and password file <none>
I20260810 04:15:06.611900 28962 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:06.611964 28962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:06.613114 28962 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:06.613638 28979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.613839 28962 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.613929 28962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "386a9742afdb4c9080ac85c9a2c6f2e2"
format_stamp: "Formatted at 2026-08-10 04:14:25 on dist-test-slave-0kls"
server_key: "a58a8c5e717b40e880fd384653f55d14"
server_key_iv: "cdbf299d064ee72e2b6f3e2b3cc5c34c"
server_key_version: "encryptionkey@0"
I20260810 04:15:06.614230 28962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:06.633529 28962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:06.635190 28962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:06.635336 28962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:06.635538 28962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:06.635812 28962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:06.635864 28962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.635900 28962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:06.635926 28962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:06.641415 28962 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:38739
I20260810 04:15:06.641484 29098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:38739 every 8 connection(s)
I20260810 04:15:06.641817 28962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:15:06.642771 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:06.642428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:40221)
0810 04:15:06.642569 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.642630 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
W20260810 04:15:06.643124 29099 heartbeater.cc:644] Failed to heartbeat to 127.10.249.190:38601 (0 consecutive failures): Network error: Failed to ping master at 127.10.249.190:38601: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
I20260810 04:15:06.643435 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:06.643333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:34185)
0810 04:15:06.643391 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.643416 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 04:15:06.643700 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:06.643618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:59471)
0810 04:15:06.643661 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:06.643687 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:15:06.643803 29099 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 04:15:06.648833 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 28962
I20260810 04:15:07.445417 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:07.445207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:38971)
0810 04:15:07.445322 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:07.445358 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260810 04:15:07.525121 29105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:07.524926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:34237)
0810 04:15:07.525038 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:07.525072 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260810 04:15:07.644227 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:07.644051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:33603)
0810 04:15:07.644151 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:07.644186 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":51,"threads_started":1}
I20260810 04:15:07.801539 29107 raft_consensus.cc:482] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:07.801666 29107 raft_consensus.cc:504] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:15:07.802114 29107 leader_election.cc:288] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319), 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
Aug 10 04:15:07 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335306, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.130@KRBTEST.COM
Aug 10 04:15:07 dist-test-slave-0kls krb5kdc[27430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335306, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.131@KRBTEST.COM
I20260810 04:15:07.812644 29108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:07.802317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:38739 (local address 127.10.249.129:60901)
0810 04:15:07.802427 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:07.802435 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:07.802475 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:07.803225 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:07.803228 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:07.803607 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:07.803823 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:07.803830 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:07.804928 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:07.804929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:07.805763 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:07.805765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:07.806411 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:07.806412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:07.806526 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:07.807100 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:07.807108 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:07.809105 (+ 1997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:07.811038 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:07.811039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:07.811039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:07.811307 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:07.811583 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:07.811585 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:07.811585 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:07.811728 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:07.812112 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:07.812113 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:07.812244 (+ 131us) client_negotiation.cc:769] Sending connection context
0810 04:15:07.812347 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 04:15:07.812538 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":49,"thread_start_us":60,"threads_started":1}
I20260810 04:15:07.812667 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:07.802399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:60901 (local address 127.10.249.131:38739)
0810 04:15:07.802525 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:07.802536 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:07.802574 (+ 38us) server_negotiation.cc:407] Connection header received
0810 04:15:07.803000 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:07.803002 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:07.803044 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:07.803216 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:07.803987 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:07.804827 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:07.805907 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:07.806305 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:07.806433 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:07.809226 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:07.809237 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:07.809237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:07.809248 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:07.810950 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:07.811395 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:07.811398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:07.811398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:07.811494 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:07.811805 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:07.811806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:07.811806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:07.812032 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:07.812119 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:07.812414 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 04:15:07.812542 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":48,"threads_started":1}
I20260810 04:15:07.812688 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:07.802354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:55617 (local address 127.10.249.130:46319)
0810 04:15:07.802510 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:07.802524 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:07.802569 (+ 45us) server_negotiation.cc:407] Connection header received
0810 04:15:07.803005 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:07.803006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:07.803044 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:07.803196 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:07.803961 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:07.804838 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:07.805906 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:07.806300 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:07.806415 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:07.808831 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:07.808835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:07.808835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:07.808844 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:07.810897 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:07.811393 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:07.811397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:07.811397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:07.811493 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:07.811798 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:07.811799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:07.811800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:07.812033 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:07.812124 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:07.812416 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 04:15:07.812558 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260810 04:15:07.812762 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:07.802236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:46319 (local address 127.10.249.129:55617)
0810 04:15:07.802298 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:07.802309 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:07.802370 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:07.803225 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:07.803228 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:07.803607 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:07.803823 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:07.803830 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:07.804956 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:07.804957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:07.805763 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:07.805766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:07.806394 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:07.806395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:07.806516 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:07.807166 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:07.807171 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:07.808720 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:07.810995 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:07.811002 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:07.811005 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:07.811303 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:07.811576 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:07.811577 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:07.811578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:07.811727 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:07.812107 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:07.812113 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:07.812244 (+ 131us) client_negotiation.cc:769] Sending connection context
0810 04:15:07.812347 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 04:15:07.812623 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":160}
W20260810 04:15:07.814060 28693 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
W20260810 04:15:07.814129 28692 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
I20260810 04:15:07.814198 28692 leader_election.cc:302] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca00073dda214dac803f01bb1785d61c; no voters: 386a9742afdb4c9080ac85c9a2c6f2e2, fc0500332e174645bfb46d0877f6ac40
I20260810 04:15:07.814319 29107 raft_consensus.cc:2726] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:15:08.446087 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:08.445914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:48155)
0810 04:15:08.446015 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:08.446044 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":52,"threads_started":1}
I20260810 04:15:08.525871 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:08.525602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:42717)
0810 04:15:08.525751 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:08.525829 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260810 04:15:08.644815 29113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:08.644640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:59633)
0810 04:15:08.644756 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:08.644786 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260810 04:15:09.403548 29114 raft_consensus.cc:482] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:09.403632 29114 raft_consensus.cc:504] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:15:09.403826 29114 leader_election.cc:288] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319), 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
W20260810 04:15:09.404279 28693 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
W20260810 04:15:09.404361 28692 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
I20260810 04:15:09.404453 28692 leader_election.cc:302] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca00073dda214dac803f01bb1785d61c; no voters: 386a9742afdb4c9080ac85c9a2c6f2e2, fc0500332e174645bfb46d0877f6ac40
I20260810 04:15:09.404544 29114 raft_consensus.cc:2726] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:15:09.446733 29115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:09.446485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:35985)
0810 04:15:09.446620 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:09.446654 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
I20260810 04:15:09.526476 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:09.526292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:48923)
0810 04:15:09.526404 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:09.526436 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260810 04:15:09.645397 29117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:09.645220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:37235)
0810 04:15:09.645326 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:09.645362 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":55,"threads_started":1}
I20260810 04:15:10.447366 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:10.447185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:48005)
0810 04:15:10.447291 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:10.447320 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260810 04:15:10.527091 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:10.526894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:40465)
0810 04:15:10.527024 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:10.527058 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260810 04:15:10.646170 29120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:10.645976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:57405)
0810 04:15:10.646103 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:10.646137 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":60,"threads_started":1}
I20260810 04:15:11.180804 29121 raft_consensus.cc:482] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:11.180902 29121 raft_consensus.cc:504] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:15:11.181115 29121 leader_election.cc:288] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319), 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
W20260810 04:15:11.181491 28692 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
W20260810 04:15:11.181571 28693 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
I20260810 04:15:11.181588 28693 leader_election.cc:302] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca00073dda214dac803f01bb1785d61c; no voters: 386a9742afdb4c9080ac85c9a2c6f2e2, fc0500332e174645bfb46d0877f6ac40
I20260810 04:15:11.181671 29121 raft_consensus.cc:2726] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:15:11.448050 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:11.447822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:37205)
0810 04:15:11.447965 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:11.448003 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":58,"threads_started":1}
I20260810 04:15:11.527665 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:11.527459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:35847)
0810 04:15:11.527580 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:11.527627 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":57,"threads_started":1}
I20260810 04:15:11.646754 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:11.646580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:57221)
0810 04:15:11.646692 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:11.646722 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":52,"threads_started":1}
I20260810 04:15:12.448727 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:12.448488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:52523)
0810 04:15:12.448627 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:12.448678 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":59,"threads_started":1}
I20260810 04:15:12.528345 29127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:12.528130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:49471)
0810 04:15:12.528265 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:12.528304 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260810 04:15:12.647322 29128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:12.647131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:52457)
0810 04:15:12.647257 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:12.647289 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":55,"threads_started":1}
I20260810 04:15:13.449471 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:13.449269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:46261)
0810 04:15:13.449392 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:13.449427 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260810 04:15:13.476109 29130 raft_consensus.cc:482] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:13.476199 29130 raft_consensus.cc:504] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:15:13.476349 29130 leader_election.cc:288] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319), 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
W20260810 04:15:13.476758 28693 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
W20260810 04:15:13.476824 28692 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
I20260810 04:15:13.476850 28693 leader_election.cc:302] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca00073dda214dac803f01bb1785d61c; no voters: 386a9742afdb4c9080ac85c9a2c6f2e2, fc0500332e174645bfb46d0877f6ac40
I20260810 04:15:13.476940 29130 raft_consensus.cc:2726] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:15:13.529055 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:13.528804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:55557)
0810 04:15:13.528954 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:13.528988 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
I20260810 04:15:13.648025 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:13.647831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:40015)
0810 04:15:13.647944 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:13.647976 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":56,"threads_started":1}
I20260810 04:15:14.450268 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:14.450073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:55061)
0810 04:15:14.450187 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:14.450223 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":58,"threads_started":1}
I20260810 04:15:14.529646 29134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:14.529445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:41393)
0810 04:15:14.529553 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:14.529604 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":54,"threads_started":1}
I20260810 04:15:14.648615 29135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:14.648440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:59545)
0810 04:15:14.648547 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:14.648579 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
I20260810 04:15:15.450901 29136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:15.450680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:35983)
0810 04:15:15.450820 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:15.450855 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260810 04:15:15.530313 29137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:15.530128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:50751)
0810 04:15:15.530255 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:15.530282 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260810 04:15:15.649406 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:15.649144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:59555)
0810 04:15:15.649337 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:15.649370 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":53,"threads_started":1}
I20260810 04:15:16.238184 29139 raft_consensus.cc:482] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:16.238282 29139 raft_consensus.cc:504] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:15:16.238514 29139 leader_election.cc:288] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319), 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
W20260810 04:15:16.238922 28692 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
W20260810 04:15:16.239041 28693 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
I20260810 04:15:16.239141 28693 leader_election.cc:302] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca00073dda214dac803f01bb1785d61c; no voters: 386a9742afdb4c9080ac85c9a2c6f2e2, fc0500332e174645bfb46d0877f6ac40
I20260810 04:15:16.239223 29139 raft_consensus.cc:2726] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:15:16.451732 29140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:16.451485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:60595)
0810 04:15:16.451638 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:16.451684 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260810 04:15:16.530963 29141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:16.530738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:49601)
0810 04:15:16.530888 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:16.530919 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":83,"threads_started":1}
I20260810 04:15:16.650285 29142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:16.650075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:53031)
0810 04:15:16.650213 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:16.650249 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260810 04:15:17.452491 29143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:17.452294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:50707)
0810 04:15:17.452416 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:17.452449 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260810 04:15:17.531718 29145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:17.531501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:53491)
0810 04:15:17.531625 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:17.531666 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
I20260810 04:15:17.650940 29146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:17.650758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:43825)
0810 04:15:17.650873 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:17.650906 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":55,"threads_started":1}
I20260810 04:15:18.453277 29147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:18.453034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:48421)
0810 04:15:18.453189 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:18.453233 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":64,"threads_started":1}
I20260810 04:15:18.532557 29148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:18.532345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:56935)
0810 04:15:18.532490 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:18.532525 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260810 04:15:18.642233 29150 raft_consensus.cc:482] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:18.642347 29150 raft_consensus.cc:504] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0500332e174645bfb46d0877f6ac40" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 46319 } } peers { permanent_uuid: "386a9742afdb4c9080ac85c9a2c6f2e2" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 38739 } } peers { permanent_uuid: "ca00073dda214dac803f01bb1785d61c" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37181 } }
I20260810 04:15:18.642525 29150 leader_election.cc:288] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319), 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739)
W20260810 04:15:18.642851 28693 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 386a9742afdb4c9080ac85c9a2c6f2e2 (127.10.249.131:38739): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
W20260810 04:15:18.642963 28692 leader_election.cc:341] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fc0500332e174645bfb46d0877f6ac40 (127.10.249.130:46319): Not found: Tablet not found: 679145365f914ad3bf387b37db98bebf
I20260810 04:15:18.642997 28692 leader_election.cc:302] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca00073dda214dac803f01bb1785d61c; no voters: 386a9742afdb4c9080ac85c9a2c6f2e2, fc0500332e174645bfb46d0877f6ac40
I20260810 04:15:18.643275 29150 raft_consensus.cc:2726] T 679145365f914ad3bf387b37db98bebf P ca00073dda214dac803f01bb1785d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:15:18.651641 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:18.651467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:55431)
0810 04:15:18.651580 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:18.651611 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260810 04:15:19.453994 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:19.453736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:47331)
0810 04:15:19.453905 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:19.453946 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
I20260810 04:15:19.533218 29153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:19.532953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:56691)
0810 04:15:19.533076 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:19.533121 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":51,"threads_started":1}
I20260810 04:15:19.652294 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:19.652101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:41385)
0810 04:15:19.652222 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:19.652254 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260810 04:15:20.454634 29155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:20.454414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:53043)
0810 04:15:20.454558 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:20.454591 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260810 04:15:20.533949 29156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:20.533694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:35123)
0810 04:15:20.533872 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:20.533907 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":124,"threads_started":1}
I20260810 04:15:20.653052 29157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:20.652802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:36453)
0810 04:15:20.652983 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:20.653015 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":54,"threads_started":1}
I20260810 04:15:21.455571 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:21.455333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.129:52743)
0810 04:15:21.455484 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:21.455528 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
I20260810 04:15:21.534798 29159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:21.534564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.130:59877)
0810 04:15:21.534716 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:21.534761 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":67,"threads_started":1}
I20260810 04:15:21.653970 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:21.653714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:38601 (local address 127.10.249.131:57655)
0810 04:15:21.653890 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:21.653929 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.190:38601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":81,"threads_started":1}
I20260810 04:15:21.660545 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 28637
I20260810 04:15:21.666975 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 28818
I20260810 04:15:21.672390 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 28962
2026-08-10T04:15:21Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58225 ms)
[----------] 30 tests from SecurityITest (252709 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:21 dist-test-slave-0kls krb5kdc[29164](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:21 dist-test-slave-0kls krb5kdc[29164](info): set up 2 sockets
Aug 10 04:15:21 dist-test-slave-0kls krb5kdc[29164](info): commencing operation
krb5kdc: starting...
W20260810 04:15:22.768942 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.972s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:22 dist-test-slave-0kls krb5kdc[29164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:22.882457 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43655
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:43655
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:22.963104 29178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:22.963284 29178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:22.963304 29178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:22.964279 29178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:22.964315 29178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:22.964327 29178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:22.964339 29178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:22.964383 29178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:22.965629 29178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:43655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:22.965876 29178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:22.966086 29178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:15:22.970947 29178 server_base.cc:1034] running on GCE node
W20260810 04:15:22.970861 29186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:22.970899 29183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:22.970866 29184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:22.971433 29178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:22.971696 29178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:22.972832 29178 hybrid_clock.cc:648] HybridClock initialized: now 1786335322972819 us; error 28 us; skew 500 ppm
Aug 10 04:15:22 dist-test-slave-0kls krb5kdc[29164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335322, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:22.975214 29178 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:22.975595 29178 webserver.cc:460] Webserver started at http://127.10.249.190:46061/ using document root <none> and password file <none>
I20260810 04:15:22.975788 29178 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:22.975824 29178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:22.975904 29178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:22.976799 29178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "e6be1d8f4853442d99b9d1856e701203"
format_stamp: "Formatted at 2026-08-10 04:15:22 on dist-test-slave-0kls"
server_key: "e495c3b1701de578aedddb16a912f5fb"
server_key_iv: "a8a76c5811832e50b32df28c78f15afe"
server_key_version: "encryptionkey@0"
I20260810 04:15:22.977077 29178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "e6be1d8f4853442d99b9d1856e701203"
format_stamp: "Formatted at 2026-08-10 04:15:22 on dist-test-slave-0kls"
server_key: "e495c3b1701de578aedddb16a912f5fb"
server_key_iv: "a8a76c5811832e50b32df28c78f15afe"
server_key_version: "encryptionkey@0"
I20260810 04:15:22.978389 29178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:22.979095 29193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:22.979266 29178 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:22.979377 29178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "e6be1d8f4853442d99b9d1856e701203"
format_stamp: "Formatted at 2026-08-10 04:15:22 on dist-test-slave-0kls"
server_key: "e495c3b1701de578aedddb16a912f5fb"
server_key_iv: "a8a76c5811832e50b32df28c78f15afe"
server_key_version: "encryptionkey@0"
I20260810 04:15:22.979454 29178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:22.990746 29178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:22.992314 29178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:22.992475 29178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:22.996415 29178 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:43655
I20260810 04:15:22.996444 29248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:43655 every 8 connection(s)
I20260810 04:15:22.996747 29178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:22.997628 29249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:22.997623 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 29178
I20260810 04:15:22.997766 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:22.998010 11238 external_mini_cluster.cc:1428] Setting key cebfe99b5a37cf5284f7f13c8338dfd1
I20260810 04:15:23.000880 29249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203: Bootstrap starting.
I20260810 04:15:23.001569 29249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:23.001969 29249 log.cc:824] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:23.002769 29249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203: No bootstrap required, opened a new log
Aug 10 04:15:22 dist-test-slave-0kls krb5kdc[29164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:23.005249 29249 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6be1d8f4853442d99b9d1856e701203" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43655 } }
I20260810 04:15:23.005401 29249 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:23.005462 29249 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6be1d8f4853442d99b9d1856e701203, State: Initialized, Role: FOLLOWER
I20260810 04:15:23.005668 29249 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6be1d8f4853442d99b9d1856e701203" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43655 } }
I20260810 04:15:23.005760 29249 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:23.005836 29249 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:23.005919 29249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:23.006636 29249 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6be1d8f4853442d99b9d1856e701203" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43655 } }
I20260810 04:15:23.006745 29249 leader_election.cc:302] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6be1d8f4853442d99b9d1856e701203; no voters:
I20260810 04:15:23.006892 29249 leader_election.cc:288] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:23.007084 29255 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:23.007141 29249 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:23.007256 29255 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [term 1 LEADER]: Becoming Leader. State: Replica: e6be1d8f4853442d99b9d1856e701203, State: Running, Role: LEADER
I20260810 04:15:23.007390 29255 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6be1d8f4853442d99b9d1856e701203" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43655 } }
I20260810 04:15:23.007743 29255 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6be1d8f4853442d99b9d1856e701203. Latest consensus state: current_term: 1 leader_uuid: "e6be1d8f4853442d99b9d1856e701203" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6be1d8f4853442d99b9d1856e701203" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43655 } } }
I20260810 04:15:23.007875 29255 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:23.008046 29256 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6be1d8f4853442d99b9d1856e701203" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6be1d8f4853442d99b9d1856e701203" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43655 } } }
I20260810 04:15:23.008314 29256 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:23.009089 29263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:23.009160 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:22.998527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.10.249.190:43655)
0810 04:15:22.998698 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:22.998706 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:22.998731 (+ 25us) server_negotiation.cc:407] Connection header received
0810 04:15:22.999182 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:22.999188 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:22.999232 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:22.999342 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:23.000166 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.001207 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.002267 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.002750 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.002832 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.005347 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:23.005351 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:23.005351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:23.005370 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:23.007350 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.007760 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.007763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.007764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.007857 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.008074 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.008075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.008076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.008448 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:23.008653 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.008790 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.008944 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
I20260810 04:15:23.010097 29263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:23.011438 29263 catalog_manager.cc:1347] Generated new cluster ID: d8b442bd798d467e99642b39b511e045
I20260810 04:15:23.011493 29263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:23.016857 29263 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:23.017427 29263 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:23.023512 29263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203: Generated new TSK 0
I20260810 04:15:23.023707 29263 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:15:23.056131 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43655
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:23.137748 29275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:23.137951 29275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:23.137974 29275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:23.139048 29275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:23.139082 29275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:23.139107 29275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:15:23.140470 29275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:23.140635 29275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:23.140795 29275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:15:23.145352 29275 server_base.cc:1034] running on GCE node
W20260810 04:15:23.145283 29281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:23.145300 29284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:23.145288 29280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:23.145851 29275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:23.146093 29275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:23.147224 29275 hybrid_clock.cc:648] HybridClock initialized: now 1786335323147209 us; error 30 us; skew 500 ppm
Aug 10 04:15:23 dist-test-slave-0kls krb5kdc[29164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:23.154992 29275 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:15:23.155407 29275 webserver.cc:460] Webserver started at http://127.10.249.129:39385/ using document root <none> and password file <none>
I20260810 04:15:23.155611 29275 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:23.155651 29275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:23.155799 29275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:23.156770 29275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "c0b7356166caed86a94086494cd5c355"
server_key_iv: "b47b994d4a0363346f350612e7c4f766"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.157117 29275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "c0b7356166caed86a94086494cd5c355"
server_key_iv: "b47b994d4a0363346f350612e7c4f766"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.158545 29275 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:15:23.159287 29291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.159479 29275 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.159569 29275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "c0b7356166caed86a94086494cd5c355"
server_key_iv: "b47b994d4a0363346f350612e7c4f766"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.159665 29275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:23.166075 29275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:23.167762 29275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:23.167862 29275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:23.167999 29275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:23.168223 29275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:23.168249 29275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.168267 29275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:23.168278 29275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.174055 29275 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:35989
I20260810 04:15:23.174126 29411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:35989 every 8 connection(s)
I20260810 04:15:23.174412 29275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:15:23 dist-test-slave-0kls krb5kdc[29164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:23.181680 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 29275
I20260810 04:15:23.181808 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:15:23.182044 11238 external_mini_cluster.cc:1428] Setting key ea9d1f4b4ce0c7ac836aac6366ffe97f
I20260810 04:15:23.183552 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.175107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:58215 (local address 127.10.249.190:43655)
0810 04:15:23.175180 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.175186 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.175391 (+ 205us) server_negotiation.cc:407] Connection header received
0810 04:15:23.175840 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.175841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.175854 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.175912 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:23.176772 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.177243 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.178255 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.178491 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.178560 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.180524 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:23.180525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:23.180526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:23.180532 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:23.182183 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.182556 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.182558 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.182558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.182613 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.182852 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.182853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.182854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.182966 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:23.183040 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.183334 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.183433 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:15:23.184091 29414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.175087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43655 (local address 127.10.249.129:58215)
0810 04:15:23.175272 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.175303 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:23.175747 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:23.175977 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:23.175980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:23.176492 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:23.176671 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.176675 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.177328 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.177329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.178162 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.178165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.178582 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.178583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.178699 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.179093 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:23.179101 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:23.180439 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:23.182279 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:23.182285 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:23.182286 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:23.182476 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:23.182690 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:23.182691 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:23.182691 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:23.182786 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:23.183032 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:23.183039 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:23.183179 (+ 140us) client_negotiation.cc:769] Sending connection context
0810 04:15:23.183647 (+ 468us) client_negotiation.cc:240] Negotiation successful
0810 04:15:23.183852 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":106,"threads_started":1}
I20260810 04:15:23.184792 29412 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43655
I20260810 04:15:23.184880 29412 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:23.185034 29412 heartbeater.cc:511] Master 127.10.249.190:43655 requested a full tablet report, sending...
I20260810 04:15:23.185612 29210 ts_manager.cc:194] Registered new tserver with Master: 5080565f8b4d47f6b2a8f5b7d6de1c3e (127.10.249.129:35989)
I20260810 04:15:23.186512 29210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:58215
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:15:23.207996 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43655
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:23.286803 29417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:23.286988 29417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:23.287009 29417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:23.288117 29417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:23.288156 29417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:23.288204 29417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:15:23.289637 29417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:23.289909 29417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:23.290117 29417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:15:23.294763 29417 server_base.cc:1034] running on GCE node
W20260810 04:15:23.294859 29425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:23.294790 29422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:23.294792 29423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:23.295133 29417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:23.295356 29417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:23.296501 29417 hybrid_clock.cc:648] HybridClock initialized: now 1786335323296492 us; error 49 us; skew 500 ppm
Aug 10 04:15:23 dist-test-slave-0kls krb5kdc[29164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:23.298883 29417 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:15:23.299278 29417 webserver.cc:460] Webserver started at http://127.10.249.130:34343/ using document root <none> and password file <none>
I20260810 04:15:23.299492 29417 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:23.299568 29417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:23.299719 29417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:23.300789 29417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "7a03117570404174a6892d67fb5da941"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "b15259247dc0a136ae68725f14df8902"
server_key_iv: "524df4cd5297df7435fd87c87b09c8e1"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.301146 29417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "7a03117570404174a6892d67fb5da941"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "b15259247dc0a136ae68725f14df8902"
server_key_iv: "524df4cd5297df7435fd87c87b09c8e1"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.302453 29417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:23.303159 29432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.303378 29417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:23.303465 29417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "7a03117570404174a6892d67fb5da941"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "b15259247dc0a136ae68725f14df8902"
server_key_iv: "524df4cd5297df7435fd87c87b09c8e1"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.303516 29417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:23.321467 29417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:23.323287 29417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:23.323386 29417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:23.323549 29417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:23.323766 29417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:23.323812 29417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.323832 29417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:23.323858 29417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.329063 29417 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:37491
I20260810 04:15:23.329171 29551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:37491 every 8 connection(s)
I20260810 04:15:23.329457 29417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:15:23.333040 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 29417
I20260810 04:15:23.333179 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:15:23.333372 11238 external_mini_cluster.cc:1428] Setting key 9b78730e57ea8b1c844258753ef5a328
Aug 10 04:15:23 dist-test-slave-0kls krb5kdc[29164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:23.339047 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.330229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:39435 (local address 127.10.249.190:43655)
0810 04:15:23.330317 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.330320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.330480 (+ 160us) server_negotiation.cc:407] Connection header received
0810 04:15:23.331007 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.331009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.331022 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.331065 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:23.331969 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.332488 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.333859 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.334165 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.334235 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.336211 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:23.336212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:23.336213 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:23.336221 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:23.337658 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.338065 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.338066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.338067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.338130 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.338363 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.338364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.338364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.338530 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:23.338613 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.338852 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.338938 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 04:15:23.339061 29554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.330180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43655 (local address 127.10.249.130:39435)
0810 04:15:23.330350 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.330389 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:23.330889 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:23.331139 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:23.331142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:23.331678 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:23.331856 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.331878 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.332583 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.332585 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.333741 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.333744 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.334239 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.334240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.334341 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.334833 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:23.334849 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:23.336127 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:23.337736 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:23.337742 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:23.337744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:23.337994 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:23.338202 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:23.338203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:23.338203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:23.338292 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:23.338601 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:23.338607 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:23.338719 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 04:15:23.338802 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 04:15:23.338913 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
I20260810 04:15:23.339537 29552 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43655
I20260810 04:15:23.339663 29552 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:23.339896 29552 heartbeater.cc:511] Master 127.10.249.190:43655 requested a full tablet report, sending...
I20260810 04:15:23.340279 29210 ts_manager.cc:194] Registered new tserver with Master: 7a03117570404174a6892d67fb5da941 (127.10.249.130:37491)
I20260810 04:15:23.340734 29210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:39435
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:15:23.360661 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43655
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:36263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:23.440923 29557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:23.441133 29557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:23.441155 29557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:23.442276 29557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:23.442313 29557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:23.442339 29557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:15:23.443730 29557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:36263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:23.443939 29557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:23.444229 29557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:23.449283 29562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:23.449352 29563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:23.449277 29565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:23.449397 29557 server_base.cc:1034] running on GCE node
I20260810 04:15:23.449592 29557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:23.449887 29557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:23.451071 29557 hybrid_clock.cc:648] HybridClock initialized: now 1786335323451048 us; error 54 us; skew 500 ppm
Aug 10 04:15:23 dist-test-slave-0kls krb5kdc[29164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:23.453619 29557 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:15:23.454121 29557 webserver.cc:460] Webserver started at http://127.10.249.131:36687/ using document root <none> and password file <none>
I20260810 04:15:23.454341 29557 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:23.454406 29557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:23.454536 29557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:23.455571 29557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "16937786770e44398d3bcbef3d037833"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "2646c21abe3892b4ade981ebd57f2cb3"
server_key_iv: "c6e077e889cc74c6a04bfdabce399447"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.455902 29557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "16937786770e44398d3bcbef3d037833"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "2646c21abe3892b4ade981ebd57f2cb3"
server_key_iv: "c6e077e889cc74c6a04bfdabce399447"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.457260 29557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:23.458040 29572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.458204 29557 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:23.458312 29557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "16937786770e44398d3bcbef3d037833"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "2646c21abe3892b4ade981ebd57f2cb3"
server_key_iv: "c6e077e889cc74c6a04bfdabce399447"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.458386 29557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:23.477056 29557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:23.478935 29557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:23.479111 29557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:23.479346 29557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:23.479688 29557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:23.479737 29557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.479784 29557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:23.479807 29557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.485982 29557 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:40235
I20260810 04:15:23.486024 29688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:40235 every 8 connection(s)
I20260810 04:15:23.486397 29557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:15:23 dist-test-slave-0kls krb5kdc[29164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335323, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:23.495460 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 29557
I20260810 04:15:23.495580 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:15:23.495800 11238 external_mini_cluster.cc:1428] Setting key 0c6ce8309412b89e87c3abc1ff550699
I20260810 04:15:23.495949 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.487116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:56609 (local address 127.10.249.190:43655)
0810 04:15:23.487180 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.487182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.487416 (+ 234us) server_negotiation.cc:407] Connection header received
0810 04:15:23.487955 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.487956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.487969 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.488036 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:23.489035 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.489558 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.490641 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.490838 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.490918 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.492980 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:23.492982 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:23.492983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:23.492990 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:23.494502 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.494966 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.494967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.494968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.495026 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.495276 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.495277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.495278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.495391 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:23.495462 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.495783 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.495861 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:15:23.496143 29691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.487100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43655 (local address 127.10.249.131:56609)
0810 04:15:23.487269 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.487317 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:23.487849 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:23.488110 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:23.488114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:23.488726 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:23.488920 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.488925 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.489662 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.489663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.490540 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.490543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.490940 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.490941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.491060 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.491534 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:23.491542 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:23.492884 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:23.494583 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:23.494590 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:23.494592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:23.494887 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:23.495100 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:23.495101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:23.495102 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:23.495204 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:23.495453 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:23.495460 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:23.495632 (+ 172us) client_negotiation.cc:769] Sending connection context
0810 04:15:23.495761 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 04:15:23.495914 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260810 04:15:23.496627 29689 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43655
I20260810 04:15:23.496754 29689 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:23.496955 29689 heartbeater.cc:511] Master 127.10.249.190:43655 requested a full tablet report, sending...
I20260810 04:15:23.497309 29210 ts_manager.cc:194] Registered new tserver with Master: 16937786770e44398d3bcbef3d037833 (127.10.249.131:40235)
I20260810 04:15:23.497624 29210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:56609
I20260810 04:15:23.507741 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:15:23.515072 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.509383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48158 (local address 127.10.249.190:43655)
0810 04:15:23.509431 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.509433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.509543 (+ 110us) server_negotiation.cc:407] Connection header received
0810 04:15:23.509621 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.509621 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.509632 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.509676 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:23.510312 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.510772 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.511459 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.511637 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.511712 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.512746 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:23.512747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:23.512748 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:23.512755 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:23.513904 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.514230 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.514231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.514231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.514289 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:23.514479 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:23.514479 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:23.514480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:23.514688 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:23.514819 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.514911 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.514985 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:15:23.516317 29210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:15:23.517768 29210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:15:23.524140 29702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.520236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.10.249.130:37491)
0810 04:15:23.520681 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.520686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.520696 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:15:23.520733 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.520735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.520750 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.520979 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:23.521056 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.522053 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.523271 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.523757 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.523837 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.523891 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.524023 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.524062 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":86,"threads_started":1}
I20260810 04:15:23.524129 29700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.519975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37491 (local address 127.0.0.1:38078)
0810 04:15:23.520508 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.520518 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:23.520562 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:23.520850 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:23.520851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:23.520853 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:23.520900 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.520902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.522160 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.522162 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.523190 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.523192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.523834 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.523835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.523905 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.523917 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 04:15:23.524006 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 04:15:23.524054 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":71,"threads_started":1}
I20260810 04:15:23.524305 29703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.520333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33008 (local address 127.10.249.129:35989)
0810 04:15:23.520509 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.520513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.520555 (+ 42us) server_negotiation.cc:407] Connection header received
0810 04:15:23.520597 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.520599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.520616 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.520706 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:23.520934 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.521589 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.523032 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.523781 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.523847 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.523897 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.524186 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.524230 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260810 04:15:23.524338 29698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.519958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:40235 (local address 127.0.0.1:51560)
0810 04:15:23.520205 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.520217 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:23.520272 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:23.520584 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:23.520587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:23.520589 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:23.520653 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.520655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.522016 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.522017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.522952 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.522955 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.523870 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.523871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.524057 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.524063 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:15:23.524096 (+ 33us) client_negotiation.cc:240] Negotiation successful
0810 04:15:23.524134 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":3,"spinlock_wait_cycles":384,"thread_start_us":78,"threads_started":1}
I20260810 04:15:23.524358 29701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.520132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51560 (local address 127.10.249.131:40235)
0810 04:15:23.520394 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.520400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.520409 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:15:23.520447 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.520449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.520465 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.520750 (+ 285us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:23.520810 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.521889 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.523065 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.523780 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.524180 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.524234 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.524254 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.524286 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":98,"threads_started":1}
I20260810 04:15:23.524505 29699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.519958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:35989 (local address 127.0.0.1:33008)
0810 04:15:23.520119 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.520175 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:23.520242 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:23.520792 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:23.520793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:23.520795 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:23.520851 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.520852 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.521693 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.521694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.522939 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.522942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.523923 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.523924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.524057 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.524063 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:15:23.524111 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 04:15:23.524137 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":84,"thread_start_us":54,"threads_started":1}
I20260810 04:15:23.524960 29622 tablet_service.cc:1467] Processing CreateTablet for tablet 007f3ec1efef45baa034420511a229a8 (DEFAULT_TABLE table=test-table [id=b211e46966654e8993157d2190ddbdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:23.525120 29344 tablet_service.cc:1467] Processing CreateTablet for tablet 007f3ec1efef45baa034420511a229a8 (DEFAULT_TABLE table=test-table [id=b211e46966654e8993157d2190ddbdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:23.525180 29483 tablet_service.cc:1467] Processing CreateTablet for tablet 007f3ec1efef45baa034420511a229a8 (DEFAULT_TABLE table=test-table [id=b211e46966654e8993157d2190ddbdec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:23.525313 29622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 007f3ec1efef45baa034420511a229a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:23.525393 29344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 007f3ec1efef45baa034420511a229a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:23.525528 29483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 007f3ec1efef45baa034420511a229a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:23.527881 29704 tablet_bootstrap.cc:492] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Bootstrap starting.
I20260810 04:15:23.528446 29705 tablet_bootstrap.cc:492] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: Bootstrap starting.
I20260810 04:15:23.528596 29704 tablet_bootstrap.cc:654] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:23.528740 29706 tablet_bootstrap.cc:492] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e: Bootstrap starting.
I20260810 04:15:23.529235 29704 log.cc:824] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:23.529372 29706 tablet_bootstrap.cc:654] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:23.529402 29705 tablet_bootstrap.cc:654] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:23.529979 29706 log.cc:824] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:23.529986 29705 log.cc:824] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:23.530189 29704 tablet_bootstrap.cc:492] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: No bootstrap required, opened a new log
I20260810 04:15:23.530251 29704 ts_tablet_manager.cc:1397] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:15:23.530663 29706 tablet_bootstrap.cc:492] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e: No bootstrap required, opened a new log
I20260810 04:15:23.530715 29706 ts_tablet_manager.cc:1397] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:15:23.530843 29705 tablet_bootstrap.cc:492] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: No bootstrap required, opened a new log
I20260810 04:15:23.530925 29705 ts_tablet_manager.cc:1397] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:15:23.532099 29704 raft_consensus.cc:348] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.532279 29704 raft_consensus.cc:374] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:23.532313 29704 raft_consensus.cc:729] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a03117570404174a6892d67fb5da941, State: Initialized, Role: FOLLOWER
I20260810 04:15:23.532198 29706 raft_consensus.cc:348] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.532353 29706 raft_consensus.cc:374] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:23.532385 29706 raft_consensus.cc:729] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5080565f8b4d47f6b2a8f5b7d6de1c3e, State: Initialized, Role: FOLLOWER
I20260810 04:15:23.532423 29704 consensus_queue.cc:260] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.532495 29706 consensus_queue.cc:260] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.532672 29704 ts_tablet_manager.cc:1428] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:15:23.532760 29706 ts_tablet_manager.cc:1428] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:15:23.532805 29552 heartbeater.cc:503] Master 127.10.249.190:43655 was elected leader, sending a full tablet report...
I20260810 04:15:23.532915 29412 heartbeater.cc:503] Master 127.10.249.190:43655 was elected leader, sending a full tablet report...
I20260810 04:15:23.532717 29705 raft_consensus.cc:348] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.533190 29705 raft_consensus.cc:374] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:23.533242 29705 raft_consensus.cc:729] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16937786770e44398d3bcbef3d037833, State: Initialized, Role: FOLLOWER
I20260810 04:15:23.533346 29705 consensus_queue.cc:260] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.533625 29689 heartbeater.cc:503] Master 127.10.249.190:43655 was elected leader, sending a full tablet report...
I20260810 04:15:23.533859 29705 ts_tablet_manager.cc:1428] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260810 04:15:23.580055 29553 tablet.cc:2369] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:15:23.675156 29413 tablet.cc:2369] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:15:23.675194 29712 raft_consensus.cc:482] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:23.675364 29712 raft_consensus.cc:504] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.675738 29712 leader_election.cc:288] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16937786770e44398d3bcbef3d037833 (127.10.249.131:40235), 7a03117570404174a6892d67fb5da941 (127.10.249.130:37491)
I20260810 04:15:23.679283 29701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.675990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:50025 (local address 127.10.249.131:40235)
0810 04:15:23.676036 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.676038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.676049 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:15:23.676078 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.676079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.676092 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.676180 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:23.676379 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.677053 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.678313 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.678917 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.678996 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.679004 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.679175 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.679213 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:15:23.679283 29702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.675997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:49771 (local address 127.10.249.130:37491)
0810 04:15:23.676040 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.676041 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.676139 (+ 98us) server_negotiation.cc:407] Connection header received
0810 04:15:23.676183 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.676184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.676192 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.676241 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:23.676378 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.677053 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.678313 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.678917 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.678996 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.679004 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.679175 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.679213 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:15:23.679289 29414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.675909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:40235 (local address 127.10.249.129:50025)
0810 04:15:23.675964 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.675976 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:23.676016 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:23.676193 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:23.676195 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:23.676196 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:23.676293 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.676295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.677129 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.677129 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.678227 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.678230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.679008 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.679009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.679092 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.679094 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:23.679150 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:15:23.679198 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":29}
I20260810 04:15:23.679296 29714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.675912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:37491 (local address 127.10.249.129:49771)
0810 04:15:23.676067 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.676076 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:23.676124 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:23.676257 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:23.676258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:23.676259 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:23.676316 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.676317 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.677129 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.677130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.678227 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:23.678230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.679009 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.679010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:23.679088 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.679093 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:15:23.679150 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 04:15:23.679198 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":70,"thread_start_us":90,"threads_started":1}
I20260810 04:15:23.679690 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "007f3ec1efef45baa034420511a229a8" candidate_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16937786770e44398d3bcbef3d037833" is_pre_election: true
I20260810 04:15:23.679873 29642 raft_consensus.cc:2454] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5080565f8b4d47f6b2a8f5b7d6de1c3e in term 0.
I20260810 04:15:23.679827 29504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "007f3ec1efef45baa034420511a229a8" candidate_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a03117570404174a6892d67fb5da941" is_pre_election: true
I20260810 04:15:23.679963 29504 raft_consensus.cc:2454] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5080565f8b4d47f6b2a8f5b7d6de1c3e in term 0.
I20260810 04:15:23.680109 29295 leader_election.cc:302] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16937786770e44398d3bcbef3d037833, 5080565f8b4d47f6b2a8f5b7d6de1c3e; no voters:
I20260810 04:15:23.680270 29712 raft_consensus.cc:2781] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:15:23.680339 29712 raft_consensus.cc:482] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:15:23.680357 29712 raft_consensus.cc:3037] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:23.681187 29712 raft_consensus.cc:504] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.681324 29712 leader_election.cc:288] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [CANDIDATE]: Term 1 election: Requested vote from peers 16937786770e44398d3bcbef3d037833 (127.10.249.131:40235), 7a03117570404174a6892d67fb5da941 (127.10.249.130:37491)
I20260810 04:15:23.681481 29504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "007f3ec1efef45baa034420511a229a8" candidate_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a03117570404174a6892d67fb5da941"
I20260810 04:15:23.681499 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "007f3ec1efef45baa034420511a229a8" candidate_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16937786770e44398d3bcbef3d037833"
I20260810 04:15:23.681556 29642 raft_consensus.cc:3037] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:23.681556 29504 raft_consensus.cc:3037] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:23.682468 29504 raft_consensus.cc:2454] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5080565f8b4d47f6b2a8f5b7d6de1c3e in term 1.
I20260810 04:15:23.682468 29642 raft_consensus.cc:2454] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5080565f8b4d47f6b2a8f5b7d6de1c3e in term 1.
I20260810 04:15:23.682634 29295 leader_election.cc:302] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16937786770e44398d3bcbef3d037833, 5080565f8b4d47f6b2a8f5b7d6de1c3e; no voters:
I20260810 04:15:23.682736 29712 raft_consensus.cc:2781] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:23.682893 29712 raft_consensus.cc:686] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [term 1 LEADER]: Becoming Leader. State: Replica: 5080565f8b4d47f6b2a8f5b7d6de1c3e, State: Running, Role: LEADER
I20260810 04:15:23.682976 29712 consensus_queue.cc:237] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } }
I20260810 04:15:23.683758 29209 catalog_manager.cc:5495] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5080565f8b4d47f6b2a8f5b7d6de1c3e (127.10.249.129). New cstate: current_term: 1 leader_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5080565f8b4d47f6b2a8f5b7d6de1c3e" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 } health_report { overall_health: UNKNOWN } } }
I20260810 04:15:23.708484 29703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.706112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33022 (local address 127.10.249.129:35989)
0810 04:15:23.706161 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.706163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.706171 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:15:23.706251 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.706252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.706272 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.706361 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:23.706498 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.706959 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.707711 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.707900 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.707969 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.708121 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:23.708247 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:23.708334 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.708352 (+ 18us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.708372 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:15:23.710338 29504 raft_consensus.cc:1261] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 1 FOLLOWER]: Refusing update from remote peer 5080565f8b4d47f6b2a8f5b7d6de1c3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:23.710341 29642 raft_consensus.cc:1261] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 1 FOLLOWER]: Refusing update from remote peer 5080565f8b4d47f6b2a8f5b7d6de1c3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:23.710744 29712 consensus_queue.cc:1035] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a03117570404174a6892d67fb5da941" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 37491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:23.710871 29715 consensus_queue.cc:1035] T 007f3ec1efef45baa034420511a229a8 P 5080565f8b4d47f6b2a8f5b7d6de1c3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "16937786770e44398d3bcbef3d037833" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 40235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:23.713896 29720 mvcc.cc:205] Tried to move back new op lower bound from 7316829485914865664 to 7316829485806022656. Current Snapshot: MvccSnapshot[applied={T|T < 7316829485914865664}]
I20260810 04:15:23.715358 29209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:23.715445 29209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:23.716166 29209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6be1d8f4853442d99b9d1856e701203: Sending DeleteTablet for 3 replicas of tablet 007f3ec1efef45baa034420511a229a8
I20260810 04:15:23.716491 29622 tablet_service.cc:1514] Processing DeleteTablet for tablet 007f3ec1efef45baa034420511a229a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:23 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:51560
I20260810 04:15:23.716503 29483 tablet_service.cc:1514] Processing DeleteTablet for tablet 007f3ec1efef45baa034420511a229a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:23 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:38078
I20260810 04:15:23.716853 29728 tablet_replica.cc:330] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: stopping tablet replica
I20260810 04:15:23.716944 29728 raft_consensus.cc:2229] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:15:23.716970 29344 tablet_service.cc:1514] Processing DeleteTablet for tablet 007f3ec1efef45baa034420511a229a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:23 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:33008
I20260810 04:15:23.717018 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 29275
I20260810 04:15:23.717036 29728 raft_consensus.cc:2258] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:23.717531 29727 tablet_replica.cc:330] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: stopping tablet replica
I20260810 04:15:23.717646 29727 raft_consensus.cc:2229] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:15:23.717737 29727 raft_consensus.cc:2258] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:23.718631 29728 ts_tablet_manager.cc:1905] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:23.719708 29727 ts_tablet_manager.cc:1905] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:23.720682 29728 ts_tablet_manager.cc:1918] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:23.720765 29728 log.cc:1196] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/007f3ec1efef45baa034420511a229a8
I20260810 04:15:23.721078 29728 ts_tablet_manager.cc:1939] T 007f3ec1efef45baa034420511a229a8 P 16937786770e44398d3bcbef3d037833: Deleting consensus metadata
I20260810 04:15:23.721474 29727 ts_tablet_manager.cc:1918] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:23.721544 29727 log.cc:1196] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/007f3ec1efef45baa034420511a229a8
I20260810 04:15:23.721514 29197 catalog_manager.cc:4841] TS 16937786770e44398d3bcbef3d037833 (127.10.249.131:40235): tablet 007f3ec1efef45baa034420511a229a8 (table test-table [id=b211e46966654e8993157d2190ddbdec]) successfully deleted
I20260810 04:15:23.721771 29727 ts_tablet_manager.cc:1939] T 007f3ec1efef45baa034420511a229a8 P 7a03117570404174a6892d67fb5da941: Deleting consensus metadata
I20260810 04:15:23.722146 29194 catalog_manager.cc:4841] TS 7a03117570404174a6892d67fb5da941 (127.10.249.130:37491): tablet 007f3ec1efef45baa034420511a229a8 (table test-table [id=b211e46966654e8993157d2190ddbdec]) successfully deleted
W20260810 04:15:23.726183 29195 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:35989 (error 108)
I20260810 04:15:23.726539 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 29417
I20260810 04:15:23.726689 29699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.726544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:35989 (local address 127.0.0.1:33030)
0810 04:15:23.726597 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:23.726634 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:35989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:15:23.727489 29195 catalog_manager.cc:4584] TS 5080565f8b4d47f6b2a8f5b7d6de1c3e (127.10.249.129:35989): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 007f3ec1efef45baa034420511a229a8: Network error: Client connection negotiation failed: client connection to 127.10.249.129:35989: connect: Connection refused (error 111)
I20260810 04:15:23.732780 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 29557
I20260810 04:15:23.737950 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 29178
2026-08-10T04:15:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1962 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T04:15:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:23Z Disabled control of system clock
I20260810 04:15:23.767293 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:35239
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:39281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:35239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:23.849092 29734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:23.849332 29734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:23.849354 29734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:23.850528 29734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:23.850565 29734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:23.850579 29734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:23.850590 29734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:23.850602 29734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:23.851886 29734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:39281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:35239
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:35239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:23.852084 29734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:23.852326 29734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:23.857131 29740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:23.857177 29742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:23.857169 29739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:23.857306 29734 server_base.cc:1034] running on GCE node
I20260810 04:15:23.857630 29734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:23.858098 29734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:23.859274 29734 hybrid_clock.cc:648] HybridClock initialized: now 1786335323859260 us; error 44 us; skew 500 ppm
I20260810 04:15:23.860635 29734 webserver.cc:460] Webserver started at http://127.10.249.190:37493/ using document root <none> and password file <none>
I20260810 04:15:23.860914 29734 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:23.861028 29734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:23.861197 29734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:23.862389 29734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "f36329cf889340de8a06d1d2b15454a4"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "ceee03f361e8e07d21479e0c480cbd4a"
server_key_iv: "166ae8d272be45fe90dde57d47479c66"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.862782 29734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "f36329cf889340de8a06d1d2b15454a4"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "ceee03f361e8e07d21479e0c480cbd4a"
server_key_iv: "166ae8d272be45fe90dde57d47479c66"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.864301 29734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:23.865052 29749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:23.865235 29734 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:23.865355 29734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "f36329cf889340de8a06d1d2b15454a4"
format_stamp: "Formatted at 2026-08-10 04:15:23 on dist-test-slave-0kls"
server_key: "ceee03f361e8e07d21479e0c480cbd4a"
server_key_iv: "166ae8d272be45fe90dde57d47479c66"
server_key_version: "encryptionkey@0"
I20260810 04:15:23.865459 29734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:23.882506 29734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:23.882834 29734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:23.883008 29734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:23.886859 29734 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:35239
I20260810 04:15:23.886904 29806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:35239 every 8 connection(s)
I20260810 04:15:23.887235 29734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:23.888453 29807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:23.891533 29807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4: Bootstrap starting.
I20260810 04:15:23.891849 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 29734
I20260810 04:15:23.891966 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:23.892155 11238 external_mini_cluster.cc:1428] Setting key e4c429d94bc2ca570b6db42662269760
I20260810 04:15:23.892275 29807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:23.892560 29807 log.cc:824] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:23.893342 29807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4: No bootstrap required, opened a new log
I20260810 04:15:23.895040 29807 raft_consensus.cc:348] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36329cf889340de8a06d1d2b15454a4" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 35239 } }
I20260810 04:15:23.895179 29807 raft_consensus.cc:374] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:23.895218 29807 raft_consensus.cc:729] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f36329cf889340de8a06d1d2b15454a4, State: Initialized, Role: FOLLOWER
I20260810 04:15:23.895334 29807 consensus_queue.cc:260] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36329cf889340de8a06d1d2b15454a4" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 35239 } }
I20260810 04:15:23.895411 29807 raft_consensus.cc:388] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:23.895448 29807 raft_consensus.cc:482] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:23.895490 29807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:23.895947 29807 raft_consensus.cc:504] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36329cf889340de8a06d1d2b15454a4" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 35239 } }
I20260810 04:15:23.896083 29807 leader_election.cc:302] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f36329cf889340de8a06d1d2b15454a4; no voters:
I20260810 04:15:23.896274 29807 leader_election.cc:288] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:23.896299 29812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:23.896437 29812 raft_consensus.cc:686] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [term 1 LEADER]: Becoming Leader. State: Replica: f36329cf889340de8a06d1d2b15454a4, State: Running, Role: LEADER
I20260810 04:15:23.896544 29807 sys_catalog.cc:564] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:23.896567 29812 consensus_queue.cc:237] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36329cf889340de8a06d1d2b15454a4" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 35239 } }
I20260810 04:15:23.897126 29811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:23.892692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34524 (local address 127.10.249.190:35239)
0810 04:15:23.892885 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:23.892892 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:23.892914 (+ 22us) server_negotiation.cc:407] Connection header received
0810 04:15:23.893275 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:23.893281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:23.893335 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:23.893482 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:23.893693 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.894554 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.895251 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:23.895746 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:23.895867 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:23.896467 (+ 600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:23.896471 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:23.896472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:23.896632 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:23.896662 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:23.896671 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:23.896742 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:23.896828 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 04:15:23.896900 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
I20260810 04:15:23.896978 29812 sys_catalog.cc:455] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f36329cf889340de8a06d1d2b15454a4. Latest consensus state: current_term: 1 leader_uuid: "f36329cf889340de8a06d1d2b15454a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36329cf889340de8a06d1d2b15454a4" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 35239 } } }
I20260810 04:15:23.897290 29812 sys_catalog.cc:458] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:23.896981 29814 sys_catalog.cc:455] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f36329cf889340de8a06d1d2b15454a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36329cf889340de8a06d1d2b15454a4" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 35239 } } }
I20260810 04:15:23.897450 29814 sys_catalog.cc:458] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:23.897698 29821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:23.898345 29821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:23.899869 29821 catalog_manager.cc:1347] Generated new cluster ID: b5bf3f4ba07244a0b908d8609db2d366
I20260810 04:15:23.899922 29821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:23.914765 29821 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:23.915267 29821 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:23.920065 29821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4: Generated new TSK 0
I20260810 04:15:23.920250 29821 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:23.924599 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:35239
--builtin_ntp_servers=127.10.249.148:39281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:24.026968 29832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:24.027185 29832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:24.027209 29832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:24.028434 29832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:24.028473 29832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:24.028498 29832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:15:24.029955 29832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:39281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:35239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:24.030232 29832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:24.030579 29832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:24.036541 29837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:24.036525 29838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:24.036525 29840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:24.036981 29832 server_base.cc:1034] running on GCE node
I20260810 04:15:24.037212 29832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:24.037478 29832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:24.038631 29832 hybrid_clock.cc:648] HybridClock initialized: now 1786335324038615 us; error 32 us; skew 500 ppm
I20260810 04:15:24.039963 29832 webserver.cc:460] Webserver started at http://127.10.249.129:40163/ using document root <none> and password file <none>
I20260810 04:15:24.040252 29832 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:24.040331 29832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:24.040486 29832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:24.041589 29832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "2eb0a528985c43d09f51b144fe14e012"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "294c3ef21250b781dc9c248b07c17af2"
server_key_iv: "149a42ce03830a1c75e550cd06b40a3e"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.042074 29832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "2eb0a528985c43d09f51b144fe14e012"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "294c3ef21250b781dc9c248b07c17af2"
server_key_iv: "149a42ce03830a1c75e550cd06b40a3e"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.043576 29832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:15:24.044356 29846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.044585 29832 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:15:24.044699 29832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "2eb0a528985c43d09f51b144fe14e012"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "294c3ef21250b781dc9c248b07c17af2"
server_key_iv: "149a42ce03830a1c75e550cd06b40a3e"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.044785 29832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:24.056002 29832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:24.056228 29832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:24.056315 29832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:24.056468 29832 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:24.056697 29832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:24.056723 29832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.056742 29832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:24.056752 29832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.062559 29832 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:42721
I20260810 04:15:24.062661 29964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:42721 every 8 connection(s)
I20260810 04:15:24.062959 29832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:15:24.067816 29811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.063671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:52341 (local address 127.10.249.190:35239)
0810 04:15:24.063750 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.063753 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.063962 (+ 209us) server_negotiation.cc:407] Connection header received
0810 04:15:24.064438 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.064439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.064450 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.064502 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:24.065117 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.065583 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.066614 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.066799 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.066852 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.067611 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:24.067612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:24.067612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:24.067617 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:24.067631 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:24.067635 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:24.067676 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.067738 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.067758 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 04:15:24.068073 29967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.063635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:35239 (local address 127.10.249.129:52341)
0810 04:15:24.063848 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.063880 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:24.064355 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:24.064552 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:24.064556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:24.064563 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:24.065051 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.065055 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.065679 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.065679 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.066534 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.066537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.066873 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.066874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.066981 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.067479 (+ 498us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:24.067479 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:24.067507 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:24.067530 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:24.067675 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:24.067678 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:24.067680 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:24.067724 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 04:15:24.067851 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":117,"threads_started":1}
I20260810 04:15:24.068676 29965 heartbeater.cc:347] Connected to a master server at 127.10.249.190:35239
I20260810 04:15:24.068778 29965 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:24.068971 29965 heartbeater.cc:511] Master 127.10.249.190:35239 requested a full tablet report, sending...
I20260810 04:15:24.069561 29766 ts_manager.cc:194] Registered new tserver with Master: 2eb0a528985c43d09f51b144fe14e012 (127.10.249.129:42721)
I20260810 04:15:24.070206 29766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.129:52341
I20260810 04:15:24.070942 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 29832
I20260810 04:15:24.071044 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:15:24.071223 11238 external_mini_cluster.cc:1428] Setting key 036614d8387a9dabf6b60ea12deb50d8
I20260810 04:15:24.072090 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:35239
--builtin_ntp_servers=127.10.249.148:39281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:24.150406 29968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:24.150625 29968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:24.150658 29968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:24.151726 29968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:24.151783 29968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:24.151820 29968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:15:24.153010 29968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:39281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:35239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:24.153260 29968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:24.153561 29968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:24.158363 29974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:24.158401 29973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:24.158401 29976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:24.158738 29968 server_base.cc:1034] running on GCE node
I20260810 04:15:24.158969 29968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:24.159214 29968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:24.160372 29968 hybrid_clock.cc:648] HybridClock initialized: now 1786335324160366 us; error 35 us; skew 500 ppm
I20260810 04:15:24.161586 29968 webserver.cc:460] Webserver started at http://127.10.249.130:46285/ using document root <none> and password file <none>
I20260810 04:15:24.161886 29968 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:24.161953 29968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:24.162089 29968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:24.163137 29968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "0c6a5955bbc1460581e1df448545c38f"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "186ba16d6dd7a2df7923bcbd42242577"
server_key_iv: "46f09c9c1008fba1f787a6def56dd4ff"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.163501 29968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "0c6a5955bbc1460581e1df448545c38f"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "186ba16d6dd7a2df7923bcbd42242577"
server_key_iv: "46f09c9c1008fba1f787a6def56dd4ff"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.164783 29968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:24.165411 29982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.165697 29968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:24.165817 29968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "0c6a5955bbc1460581e1df448545c38f"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "186ba16d6dd7a2df7923bcbd42242577"
server_key_iv: "46f09c9c1008fba1f787a6def56dd4ff"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.165897 29968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:24.189903 29968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:24.190285 29968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:24.190455 29968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:24.190698 29968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:24.191061 29968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:24.191115 29968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.191161 29968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:24.191185 29968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.196830 29968 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:40163
I20260810 04:15:24.196872 30100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:40163 every 8 connection(s)
I20260810 04:15:24.197234 29968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:15:24.202373 29811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.198038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:40903 (local address 127.10.249.190:35239)
0810 04:15:24.198120 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.198123 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.198420 (+ 297us) server_negotiation.cc:407] Connection header received
0810 04:15:24.198887 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.198888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.198899 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.198952 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:24.199593 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.200094 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.201031 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.201211 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.201259 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.202177 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:24.202178 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:24.202178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:24.202182 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:24.202194 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:24.202197 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:24.202234 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.202295 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.202315 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:15:24.202631 30103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.198007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:35239 (local address 127.10.249.130:40903)
0810 04:15:24.198237 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.198318 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:24.198806 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:24.199007 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:24.199010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:24.199019 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:24.199524 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.199529 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.200182 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.200183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.200959 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.200961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.201286 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.201287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.201398 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.202051 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:24.202052 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:24.202083 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:24.202107 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:24.202236 (+ 129us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:24.202238 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:24.202241 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:24.202287 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 04:15:24.202367 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":97,"threads_started":1}
I20260810 04:15:24.203186 30101 heartbeater.cc:347] Connected to a master server at 127.10.249.190:35239
I20260810 04:15:24.203294 30101 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:24.203480 30101 heartbeater.cc:511] Master 127.10.249.190:35239 requested a full tablet report, sending...
I20260810 04:15:24.203858 29766 ts_manager.cc:194] Registered new tserver with Master: 0c6a5955bbc1460581e1df448545c38f (127.10.249.130:40163)
I20260810 04:15:24.204202 29766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.130:40903
I20260810 04:15:24.207186 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 29968
I20260810 04:15:24.207262 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:15:24.207406 11238 external_mini_cluster.cc:1428] Setting key 32418b4747fd88f553099697680e0f5d
I20260810 04:15:24.208343 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:35239
--builtin_ntp_servers=127.10.249.148:39281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:24.290024 30104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:24.290213 30104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:24.290232 30104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:24.291373 30104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:24.291412 30104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:24.291437 30104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:15:24.292781 30104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:39281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:35239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:24.293038 30104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:24.293354 30104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:24.298148 30110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:24.298127 30109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:24.298148 30112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:24.298484 30104 server_base.cc:1034] running on GCE node
I20260810 04:15:24.298720 30104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:24.298955 30104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:24.300113 30104 hybrid_clock.cc:648] HybridClock initialized: now 1786335324300089 us; error 29 us; skew 500 ppm
I20260810 04:15:24.301589 30104 webserver.cc:460] Webserver started at http://127.10.249.131:38015/ using document root <none> and password file <none>
I20260810 04:15:24.301919 30104 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:24.301991 30104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:24.302125 30104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:24.303339 30104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "d4433043f9e248ed9904a98d8e7b89ea"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "37cb7dabfefaae21bb99ccc99b2c477d"
server_key_iv: "94f8c38c06eca2c65a444915260d8d57"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.303920 30104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "d4433043f9e248ed9904a98d8e7b89ea"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "37cb7dabfefaae21bb99ccc99b2c477d"
server_key_iv: "94f8c38c06eca2c65a444915260d8d57"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.308917 30104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.002s
I20260810 04:15:24.310289 30118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.310525 30104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:15:24.310622 30104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "d4433043f9e248ed9904a98d8e7b89ea"
format_stamp: "Formatted at 2026-08-10 04:15:24 on dist-test-slave-0kls"
server_key: "37cb7dabfefaae21bb99ccc99b2c477d"
server_key_iv: "94f8c38c06eca2c65a444915260d8d57"
server_key_version: "encryptionkey@0"
I20260810 04:15:24.310705 30104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:24.324893 30104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:24.325237 30104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:24.325405 30104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:24.325700 30104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:24.326218 30104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:24.326274 30104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.326313 30104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:24.326344 30104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:24.334867 30104 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:37083
I20260810 04:15:24.334931 30233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:37083 every 8 connection(s)
I20260810 04:15:24.335263 30104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:15:24.341169 29811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.336036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:57773 (local address 127.10.249.190:35239)
0810 04:15:24.336106 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.336108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.336475 (+ 367us) server_negotiation.cc:407] Connection header received
0810 04:15:24.337033 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.337035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.337051 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.337138 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:24.337871 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.338428 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.339549 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.339873 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.339948 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.340924 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:24.340925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:24.340925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:24.340944 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:24.340959 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:24.340962 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:24.340996 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.341094 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.341116 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:15:24.341413 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.336073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:35239 (local address 127.10.249.131:57773)
0810 04:15:24.336313 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.336358 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:24.336915 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:24.337185 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:24.337188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:24.337197 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:24.337729 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.337734 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.338582 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.338584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.339442 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.339444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.339981 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.339983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.340166 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.340733 (+ 567us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:24.340734 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:24.340775 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:24.340804 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:24.341010 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:24.341015 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:24.341017 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:24.341093 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 04:15:24.341193 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":106,"threads_started":1}
I20260810 04:15:24.342010 30234 heartbeater.cc:347] Connected to a master server at 127.10.249.190:35239
I20260810 04:15:24.342123 30234 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:24.342352 30234 heartbeater.cc:511] Master 127.10.249.190:35239 requested a full tablet report, sending...
I20260810 04:15:24.342708 29766 ts_manager.cc:194] Registered new tserver with Master: d4433043f9e248ed9904a98d8e7b89ea (127.10.249.131:37083)
I20260810 04:15:24.343173 29766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.131:57773
I20260810 04:15:24.344369 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 30104
I20260810 04:15:24.344476 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:15:24.344753 11238 external_mini_cluster.cc:1428] Setting key 1de15781d4d0840b91b3e6e3b1066d57
I20260810 04:15:24.345710 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:15:24.351023 29811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.347565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34530 (local address 127.10.249.190:35239)
0810 04:15:24.347627 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.347629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.347777 (+ 148us) server_negotiation.cc:407] Connection header received
0810 04:15:24.347801 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.347802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.347813 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.347878 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:24.348086 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.348499 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.349486 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.349758 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.349834 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.350686 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:24.350687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:24.350688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:24.350694 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:24.350712 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:24.350717 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:24.350750 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.350879 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.350904 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:15:24.353227 29766 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:15:24.356577 29766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:15:24.364732 30249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.360323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:40163 (local address 127.0.0.1:37050)
0810 04:15:24.360719 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.360730 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:24.360785 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:24.361085 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:24.361086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:24.361087 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:24.361131 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.361132 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.362212 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.362213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.363424 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.363426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.364433 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.364434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.364521 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.364534 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 04:15:24.364611 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:15:24.364664 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":36,"thread_start_us":85,"threads_started":1}
I20260810 04:15:24.364755 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.360424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37050 (local address 127.10.249.130:40163)
0810 04:15:24.360628 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.360631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.360784 (+ 153us) server_negotiation.cc:407] Connection header received
0810 04:15:24.360898 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.360900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.360918 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.361016 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:24.361201 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.362056 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.363522 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.364197 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.364290 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.364375 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.364648 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.364684 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":116,"threads_started":1}
I20260810 04:15:24.365063 30247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.360027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37130 (local address 127.10.249.131:37083)
0810 04:15:24.360351 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.360356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.360368 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:15:24.360472 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.360475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.360518 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.360619 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:24.361055 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.362177 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.363561 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.364187 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.364303 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.364388 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.364847 (+ 459us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.364886 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":91,"threads_started":1}
I20260810 04:15:24.365273 30245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.359905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:37083 (local address 127.0.0.1:37130)
0810 04:15:24.360243 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.360286 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:24.360349 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:24.360625 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:24.360628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:24.360631 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:24.360697 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.360699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.362283 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.362283 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.363423 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.363426 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.364699 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.364700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.364752 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.364756 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:15:24.365168 (+ 412us) client_negotiation.cc:240] Negotiation successful
0810 04:15:24.365209 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":61,"thread_start_us":81,"threads_started":1}
I20260810 04:15:24.365757 30246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.359829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:42721 (local address 127.0.0.1:48042)
0810 04:15:24.360240 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.360286 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:24.360653 (+ 367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:24.360968 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:24.360969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:24.360970 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:24.361017 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.361019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.363683 (+ 2664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.363684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.364606 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.364609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.365485 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.365486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.365554 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.365557 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:24.365634 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:15:24.365691 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":56,"threads_started":1}
I20260810 04:15:24.365984 30248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.360078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48042 (local address 127.10.249.129:42721)
0810 04:15:24.360537 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.360542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.360790 (+ 248us) server_negotiation.cc:407] Connection header received
0810 04:15:24.360833 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.360835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.360852 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.360944 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:24.362407 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.363603 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.364676 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.365359 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.365427 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.365497 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.365689 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.365731 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":68,"threads_started":1}
I20260810 04:15:24.365924 30032 tablet_service.cc:1467] Processing CreateTablet for tablet 7012bd2db9bd4f2fbdefcfb69278ae15 (DEFAULT_TABLE table=test-table [id=bb310c3e52624fb792b1eeb8e4b17ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:24.366096 30168 tablet_service.cc:1467] Processing CreateTablet for tablet 7012bd2db9bd4f2fbdefcfb69278ae15 (DEFAULT_TABLE table=test-table [id=bb310c3e52624fb792b1eeb8e4b17ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:24.366328 30032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7012bd2db9bd4f2fbdefcfb69278ae15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:24.366365 30168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7012bd2db9bd4f2fbdefcfb69278ae15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:24.366712 29895 tablet_service.cc:1467] Processing CreateTablet for tablet 7012bd2db9bd4f2fbdefcfb69278ae15 (DEFAULT_TABLE table=test-table [id=bb310c3e52624fb792b1eeb8e4b17ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:24.367183 29895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7012bd2db9bd4f2fbdefcfb69278ae15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:24.370358 30251 tablet_bootstrap.cc:492] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f: Bootstrap starting.
I20260810 04:15:24.370806 30252 tablet_bootstrap.cc:492] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: Bootstrap starting.
I20260810 04:15:24.371035 30253 tablet_bootstrap.cc:492] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012: Bootstrap starting.
I20260810 04:15:24.371109 30251 tablet_bootstrap.cc:654] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:24.371379 30251 log.cc:824] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:24.371464 30252 tablet_bootstrap.cc:654] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:24.371788 30252 log.cc:824] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:24.371925 30253 tablet_bootstrap.cc:654] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:24.372187 30251 tablet_bootstrap.cc:492] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f: No bootstrap required, opened a new log
I20260810 04:15:24.372217 30253 log.cc:824] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:24.372265 30251 ts_tablet_manager.cc:1397] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:15:24.372578 30252 tablet_bootstrap.cc:492] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: No bootstrap required, opened a new log
I20260810 04:15:24.372654 30252 ts_tablet_manager.cc:1397] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:15:24.373011 30253 tablet_bootstrap.cc:492] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012: No bootstrap required, opened a new log
I20260810 04:15:24.373116 30253 ts_tablet_manager.cc:1397] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:15:24.374468 30251 raft_consensus.cc:348] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.374610 30251 raft_consensus.cc:374] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:24.374634 30251 raft_consensus.cc:729] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c6a5955bbc1460581e1df448545c38f, State: Initialized, Role: FOLLOWER
I20260810 04:15:24.374749 30251 consensus_queue.cc:260] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.374997 30251 ts_tablet_manager.cc:1428] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:15:24.375032 30101 heartbeater.cc:503] Master 127.10.249.190:35239 was elected leader, sending a full tablet report...
I20260810 04:15:24.375834 30252 raft_consensus.cc:348] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.376014 30252 raft_consensus.cc:374] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:24.375880 30253 raft_consensus.cc:348] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.376083 30252 raft_consensus.cc:729] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4433043f9e248ed9904a98d8e7b89ea, State: Initialized, Role: FOLLOWER
I20260810 04:15:24.376119 30253 raft_consensus.cc:374] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:24.376209 30253 raft_consensus.cc:729] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2eb0a528985c43d09f51b144fe14e012, State: Initialized, Role: FOLLOWER
I20260810 04:15:24.376212 30252 consensus_queue.cc:260] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.376339 30253 consensus_queue.cc:260] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.376470 30252 ts_tablet_manager.cc:1428] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 04:15:24.376518 30234 heartbeater.cc:503] Master 127.10.249.190:35239 was elected leader, sending a full tablet report...
I20260810 04:15:24.376700 30253 ts_tablet_manager.cc:1428] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260810 04:15:24.376745 29965 heartbeater.cc:503] Master 127.10.249.190:35239 was elected leader, sending a full tablet report...
I20260810 04:15:24.389508 30258 raft_consensus.cc:482] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:24.389624 30258 raft_consensus.cc:504] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.389984 30258 leader_election.cc:288] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c6a5955bbc1460581e1df448545c38f (127.10.249.130:40163), 2eb0a528985c43d09f51b144fe14e012 (127.10.249.129:42721)
I20260810 04:15:24.392591 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.390157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:42721 (local address 127.10.249.131:52113)
0810 04:15:24.390237 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.390247 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:24.390286 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:24.390435 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:24.390436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:24.390438 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:24.390507 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.390508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.391150 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.391151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.391843 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.391845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.392367 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.392369 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.392454 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.392457 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:24.392512 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 04:15:24.392543 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":26}
I20260810 04:15:24.392747 30248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.390222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:52113 (local address 127.10.249.129:42721)
0810 04:15:24.390269 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.390271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.390280 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:15:24.390354 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.390355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.390365 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.390420 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:24.390580 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.391059 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.391942 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.392288 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.392339 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.392345 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.392624 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.392674 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:15:24.392848 30260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.390169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:40163 (local address 127.10.249.131:60309)
0810 04:15:24.390312 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.390323 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:24.390381 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:24.390507 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:24.390507 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:24.390508 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:24.390591 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.390593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.391134 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.391135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.391841 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:24.391843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.392458 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.392459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:24.392638 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.392641 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:24.392727 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 04:15:24.392763 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260810 04:15:24.392859 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.390202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:60309 (local address 127.10.249.130:40163)
0810 04:15:24.390243 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.390245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.390376 (+ 131us) server_negotiation.cc:407] Connection header received
0810 04:15:24.390440 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.390441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.390451 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.390504 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:24.390647 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.391061 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.391952 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.392309 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.392409 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.392416 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.392745 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.392785 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:15:24.393158 30052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7012bd2db9bd4f2fbdefcfb69278ae15" candidate_uuid: "d4433043f9e248ed9904a98d8e7b89ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c6a5955bbc1460581e1df448545c38f" is_pre_election: true
I20260810 04:15:24.393297 30052 raft_consensus.cc:2454] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4433043f9e248ed9904a98d8e7b89ea in term 0.
I20260810 04:15:24.393272 29916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7012bd2db9bd4f2fbdefcfb69278ae15" candidate_uuid: "d4433043f9e248ed9904a98d8e7b89ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2eb0a528985c43d09f51b144fe14e012" is_pre_election: true
I20260810 04:15:24.393369 29916 raft_consensus.cc:2454] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4433043f9e248ed9904a98d8e7b89ea in term 0.
I20260810 04:15:24.393499 30122 leader_election.cc:302] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6a5955bbc1460581e1df448545c38f, d4433043f9e248ed9904a98d8e7b89ea; no voters:
I20260810 04:15:24.393666 30258 raft_consensus.cc:2781] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:15:24.393723 30258 raft_consensus.cc:482] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:15:24.393765 30258 raft_consensus.cc:3037] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:24.394420 30258 raft_consensus.cc:504] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.394557 30258 leader_election.cc:288] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [CANDIDATE]: Term 1 election: Requested vote from peers 0c6a5955bbc1460581e1df448545c38f (127.10.249.130:40163), 2eb0a528985c43d09f51b144fe14e012 (127.10.249.129:42721)
I20260810 04:15:24.394727 30052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7012bd2db9bd4f2fbdefcfb69278ae15" candidate_uuid: "d4433043f9e248ed9904a98d8e7b89ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c6a5955bbc1460581e1df448545c38f"
I20260810 04:15:24.394731 29916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7012bd2db9bd4f2fbdefcfb69278ae15" candidate_uuid: "d4433043f9e248ed9904a98d8e7b89ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2eb0a528985c43d09f51b144fe14e012"
I20260810 04:15:24.394798 30052 raft_consensus.cc:3037] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:24.394798 29916 raft_consensus.cc:3037] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:24.395603 29916 raft_consensus.cc:2454] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4433043f9e248ed9904a98d8e7b89ea in term 1.
I20260810 04:15:24.395603 30052 raft_consensus.cc:2454] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4433043f9e248ed9904a98d8e7b89ea in term 1.
I20260810 04:15:24.395751 30122 leader_election.cc:302] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6a5955bbc1460581e1df448545c38f, d4433043f9e248ed9904a98d8e7b89ea; no voters:
I20260810 04:15:24.395848 30258 raft_consensus.cc:2781] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:24.395961 30258 raft_consensus.cc:686] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 1 LEADER]: Becoming Leader. State: Replica: d4433043f9e248ed9904a98d8e7b89ea, State: Running, Role: LEADER
I20260810 04:15:24.396015 30258 consensus_queue.cc:237] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } }
I20260810 04:15:24.396680 29766 catalog_manager.cc:5495] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d4433043f9e248ed9904a98d8e7b89ea (127.10.249.131). New cstate: current_term: 1 leader_uuid: "d4433043f9e248ed9904a98d8e7b89ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4433043f9e248ed9904a98d8e7b89ea" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 } health_report { overall_health: UNKNOWN } } }
I20260810 04:15:24.401000 30247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.399063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37138 (local address 127.10.249.131:37083)
0810 04:15:24.399101 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:24.399103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:24.399115 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:15:24.399198 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:24.399198 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:24.399212 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:24.399269 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:24.399356 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.399776 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.400422 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:24.400589 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:24.400635 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:24.400751 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:24.400833 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:24.400885 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:24.400928 (+ 43us) server_negotiation.cc:299] Negotiation successful
0810 04:15:24.400940 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:15:24.402872 29916 raft_consensus.cc:1261] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 1 FOLLOWER]: Refusing update from remote peer d4433043f9e248ed9904a98d8e7b89ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:24.403254 30258 consensus_queue.cc:1035] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2eb0a528985c43d09f51b144fe14e012" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 42721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:24.406157 30052 raft_consensus.cc:1261] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 1 FOLLOWER]: Refusing update from remote peer d4433043f9e248ed9904a98d8e7b89ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:24.406966 30265 mvcc.cc:205] Tried to move back new op lower bound from 7316829488751239168 to 7316829488726577152. Current Snapshot: MvccSnapshot[applied={T|T < 7316829488751239168 or (T in {7316829488751239168})}]
I20260810 04:15:24.407967 30261 consensus_queue.cc:1035] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c6a5955bbc1460581e1df448545c38f" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:24.408174 29766 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:24.408277 29766 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:24.409112 29766 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f36329cf889340de8a06d1d2b15454a4: Sending DeleteTablet for 3 replicas of tablet 7012bd2db9bd4f2fbdefcfb69278ae15
I20260810 04:15:24.409442 30168 tablet_service.cc:1514] Processing DeleteTablet for tablet 7012bd2db9bd4f2fbdefcfb69278ae15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:24 UTC) from {username='slave'} at 127.0.0.1:37130
I20260810 04:15:24.409597 29895 tablet_service.cc:1514] Processing DeleteTablet for tablet 7012bd2db9bd4f2fbdefcfb69278ae15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:24 UTC) from {username='slave'} at 127.0.0.1:48042
I20260810 04:15:24.409911 30274 tablet_replica.cc:330] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012: stopping tablet replica
I20260810 04:15:24.410058 30274 raft_consensus.cc:2229] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:15:24.410125 30032 tablet_service.cc:1514] Processing DeleteTablet for tablet 7012bd2db9bd4f2fbdefcfb69278ae15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:24 UTC) from {username='slave'} at 127.0.0.1:37050
I20260810 04:15:24.410270 30274 raft_consensus.cc:2258] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 2eb0a528985c43d09f51b144fe14e012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:24.411607 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 29832
I20260810 04:15:24.416934 30273 tablet_replica.cc:330] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: stopping tablet replica
I20260810 04:15:24.417068 30273 raft_consensus.cc:2229] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:15:24.417193 30273 raft_consensus.cc:2258] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:24.417757 30273 ts_tablet_manager.cc:1905] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:24.420137 30273 ts_tablet_manager.cc:1918] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:24.420226 30273 log.cc:1196] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/7012bd2db9bd4f2fbdefcfb69278ae15
I20260810 04:15:24.420514 30273 ts_tablet_manager.cc:1939] T 7012bd2db9bd4f2fbdefcfb69278ae15 P d4433043f9e248ed9904a98d8e7b89ea: Deleting consensus metadata
I20260810 04:15:24.421016 29750 catalog_manager.cc:4841] TS d4433043f9e248ed9904a98d8e7b89ea (127.10.249.131:37083): tablet 7012bd2db9bd4f2fbdefcfb69278ae15 (table test-table [id=bb310c3e52624fb792b1eeb8e4b17ca8]) successfully deleted
W20260810 04:15:24.423029 29752 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:42721 (error 108)
I20260810 04:15:24.423225 30275 tablet_replica.cc:330] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f: stopping tablet replica
I20260810 04:15:24.423405 30275 raft_consensus.cc:2229] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:15:24.423493 30246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.423377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:42721 (local address 127.0.0.1:48044)
0810 04:15:24.423419 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.423457 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:42721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260810 04:15:24.423518 30275 raft_consensus.cc:2258] T 7012bd2db9bd4f2fbdefcfb69278ae15 P 0c6a5955bbc1460581e1df448545c38f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:24.423712 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 29968
W20260810 04:15:24.423746 29752 catalog_manager.cc:4584] TS 2eb0a528985c43d09f51b144fe14e012 (127.10.249.129:42721): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7012bd2db9bd4f2fbdefcfb69278ae15: Network error: Client connection negotiation failed: client connection to 127.10.249.129:42721: connect: Connection refused (error 111)
I20260810 04:15:24.434449 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 30104
I20260810 04:15:24.434582 30246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:24.434436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:40163 (local address 127.0.0.1:37058)
0810 04:15:24.434508 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:24.434542 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.130:40163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 04:15:24.439010 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 29734
2026-08-10T04:15:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (700 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:24 dist-test-slave-0kls krb5kdc[30279](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:24 dist-test-slave-0kls krb5kdc[30279](info): set up 2 sockets
Aug 10 04:15:24 dist-test-slave-0kls krb5kdc[30279](info): commencing operation
krb5kdc: starting...
W20260810 04:15:25.452679 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.993s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:25 dist-test-slave-0kls krb5kdc[30279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:25.566256 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37331
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:37331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:25.641932 30294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:25.642138 30294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:25.642171 30294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:25.643214 30294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:25.643277 30294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:25.643316 30294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:25.643356 30294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:25.643378 30294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:25.644867 30294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:37331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:37331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:25.645151 30294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:25.645368 30294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:25.649989 30299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:25.650023 30302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:25.650298 30294 server_base.cc:1034] running on GCE node
W20260810 04:15:25.650377 30300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:25.650606 30294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:25.650902 30294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:25.652065 30294 hybrid_clock.cc:648] HybridClock initialized: now 1786335325652060 us; error 35 us; skew 500 ppm
Aug 10 04:15:25 dist-test-slave-0kls krb5kdc[30279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335325, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:25.654417 30294 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:25.654846 30294 webserver.cc:460] Webserver started at http://127.10.249.190:38279/ using document root <none> and password file <none>
I20260810 04:15:25.655078 30294 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:25.655139 30294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:25.655278 30294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:25.656142 30294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "5c7e5bef2d0e4ccab30a19899a6cd174"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "c8e3aec053f2aee39a5669312e10bf48"
server_key_iv: "444af037bb8ecba6f34e86c03fd2e491"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.656474 30294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "5c7e5bef2d0e4ccab30a19899a6cd174"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "c8e3aec053f2aee39a5669312e10bf48"
server_key_iv: "444af037bb8ecba6f34e86c03fd2e491"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.657682 30294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:25.658390 30309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:25.658581 30294 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:25.658689 30294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "5c7e5bef2d0e4ccab30a19899a6cd174"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "c8e3aec053f2aee39a5669312e10bf48"
server_key_iv: "444af037bb8ecba6f34e86c03fd2e491"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.658757 30294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:25.666481 30294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:25.668074 30294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:25.668184 30294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:25.672012 30294 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:37331
I20260810 04:15:25.672039 30363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:37331 every 8 connection(s)
I20260810 04:15:25.672371 30294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:25.673198 30364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:25.675318 30364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174: Bootstrap starting.
I20260810 04:15:25.675894 30364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:25.676174 30364 log.cc:824] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:25.677075 30364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174: No bootstrap required, opened a new log
I20260810 04:15:25.678757 30364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c7e5bef2d0e4ccab30a19899a6cd174" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37331 } }
I20260810 04:15:25.678889 30364 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:25.678910 30364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c7e5bef2d0e4ccab30a19899a6cd174, State: Initialized, Role: FOLLOWER
I20260810 04:15:25.679078 30364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c7e5bef2d0e4ccab30a19899a6cd174" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37331 } }
I20260810 04:15:25.679163 30364 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:25.679206 30364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:25.679257 30364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:25.679773 30364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c7e5bef2d0e4ccab30a19899a6cd174" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37331 } }
I20260810 04:15:25.679884 30364 leader_election.cc:302] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c7e5bef2d0e4ccab30a19899a6cd174; no voters:
I20260810 04:15:25.680068 30364 leader_election.cc:288] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:25.680102 30367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:25.680282 30367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [term 1 LEADER]: Becoming Leader. State: Replica: 5c7e5bef2d0e4ccab30a19899a6cd174, State: Running, Role: LEADER
I20260810 04:15:25.680337 30364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:25.680370 30367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c7e5bef2d0e4ccab30a19899a6cd174" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37331 } }
I20260810 04:15:25.680444 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 30294
I20260810 04:15:25.680580 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:25.680783 11238 external_mini_cluster.cc:1428] Setting key e2c984ea79d884c9b07c431b043a9562
I20260810 04:15:25.680836 30369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c7e5bef2d0e4ccab30a19899a6cd174. Latest consensus state: current_term: 1 leader_uuid: "5c7e5bef2d0e4ccab30a19899a6cd174" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c7e5bef2d0e4ccab30a19899a6cd174" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37331 } } }
I20260810 04:15:25.680917 30369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:25.681128 30376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:25.681706 30368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c7e5bef2d0e4ccab30a19899a6cd174" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c7e5bef2d0e4ccab30a19899a6cd174" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 37331 } } }
I20260810 04:15:25.681880 30368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:25.681901 30376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:25.683740 30376 catalog_manager.cc:1347] Generated new cluster ID: 9baccc2839824d40bd284bb3472fd202
I20260810 04:15:25.683789 30376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:15:25 dist-test-slave-0kls krb5kdc[30279](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:25.691334 30379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:25.681255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44834 (local address 127.10.249.190:37331)
0810 04:15:25.681995 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:25.682006 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:25.682043 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:15:25.682160 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:25.682167 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:25.682317 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:25.682457 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:25.683114 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:25.684124 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:25.684841 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:25.685246 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:25.685348 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:25.687557 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:25.687560 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:25.687561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:25.687572 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:25.689575 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:25.690053 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:25.690056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:25.690056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:25.690317 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:25.690515 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:25.690516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:25.690517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:25.690734 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:25.690899 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:25.690969 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 04:15:25.691186 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":98,"threads_started":1}
I20260810 04:15:25.707508 30376 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:25.707963 30376 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:25.714888 30376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174: Generated new TSK 0
I20260810 04:15:25.715058 30376 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:15:25.742093 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37331
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:25.818028 30393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:25.818230 30393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:25.818264 30393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:25.819413 30393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:25.819482 30393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:25.819527 30393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:15:25.821000 30393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:25.821233 30393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:25.821430 30393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:15:25.825955 30393 server_base.cc:1034] running on GCE node
W20260810 04:15:25.825927 30401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:25.825938 30398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:25.826076 30399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:25.826328 30393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:25.826520 30393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:25.827679 30393 hybrid_clock.cc:648] HybridClock initialized: now 1786335325827657 us; error 34 us; skew 500 ppm
Aug 10 04:15:25 dist-test-slave-0kls krb5kdc[30279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335325, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:25.830036 30393 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:15:25.830459 30393 webserver.cc:460] Webserver started at http://127.10.249.129:33647/ using document root <none> and password file <none>
I20260810 04:15:25.830706 30393 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:25.830770 30393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:25.830910 30393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:25.831818 30393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "21d0fb9a98464e9882166efd7f6bcde8"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "85cc57fa8b3072ebd1e2b5857fcb6a5e"
server_key_iv: "007b59c8d525f25ce2f3246ee5c6622d"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.832152 30393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "21d0fb9a98464e9882166efd7f6bcde8"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "85cc57fa8b3072ebd1e2b5857fcb6a5e"
server_key_iv: "007b59c8d525f25ce2f3246ee5c6622d"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.833392 30393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:15:25.834128 30408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:25.834291 30393 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:25.834396 30393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "21d0fb9a98464e9882166efd7f6bcde8"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "85cc57fa8b3072ebd1e2b5857fcb6a5e"
server_key_iv: "007b59c8d525f25ce2f3246ee5c6622d"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.834468 30393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:25.851146 30393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:25.852712 30393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:25.852859 30393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:25.853063 30393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:25.853345 30393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:25.853396 30393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:25.853426 30393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:25.853451 30393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:25.859355 30393 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:37907
I20260810 04:15:25.859403 30526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:37907 every 8 connection(s)
I20260810 04:15:25.859691 30393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:15:25 dist-test-slave-0kls krb5kdc[30279](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335325, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:25.866456 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 30393
I20260810 04:15:25.866569 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:15:25.866783 11238 external_mini_cluster.cc:1428] Setting key afe67dd0a11a58c1fbc89faf55e14074
I20260810 04:15:25.868669 30379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:25.860439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:37711 (local address 127.10.249.190:37331)
0810 04:15:25.860505 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:25.860507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:25.860718 (+ 211us) server_negotiation.cc:407] Connection header received
0810 04:15:25.861230 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:25.861231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:25.861240 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:25.861307 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:25.862304 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:25.862787 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:25.863676 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:25.863850 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:25.863897 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:25.865758 (+ 1861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:25.865760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:25.865760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:25.865767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:25.867199 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:25.867683 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:25.867684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:25.867685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:25.867750 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:25.867976 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:25.867977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:25.867978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:25.868137 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:25.868210 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:25.868430 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 04:15:25.868518 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:15:25.868681 30529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:25.860421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37331 (local address 127.10.249.129:37711)
0810 04:15:25.860589 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:25.860630 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:25.861147 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:25.861371 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:25.861374 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:25.861966 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:25.862187 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:25.862192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:25.862865 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:25.862866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:25.863602 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:25.863605 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:25.863915 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:25.863916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:25.864012 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:25.864419 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:25.864426 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:25.865669 (+ 1243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:25.867267 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:25.867273 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:25.867275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:25.867611 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:25.867819 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:25.867819 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:25.867820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:25.867915 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:25.868202 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:25.868206 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:25.868310 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 04:15:25.868387 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:15:25.868494 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":101,"threads_started":1}
I20260810 04:15:25.869328 30527 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37331
I20260810 04:15:25.869441 30527 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:25.869619 30527 heartbeater.cc:511] Master 127.10.249.190:37331 requested a full tablet report, sending...
I20260810 04:15:25.870198 30326 ts_manager.cc:194] Registered new tserver with Master: 21d0fb9a98464e9882166efd7f6bcde8 (127.10.249.129:37907)
I20260810 04:15:25.870810 30326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:37711
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:15:25.892295 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37331
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:25.970974 30532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:25.971156 30532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:25.971177 30532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:25.972209 30532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:25.972247 30532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:25.972271 30532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:15:25.973676 30532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:25.973934 30532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:25.974175 30532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:25.978533 30539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:25.978601 30538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:25.978642 30532 server_base.cc:1034] running on GCE node
W20260810 04:15:25.978533 30541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:25.978972 30532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:25.979205 30532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:25.980389 30532 hybrid_clock.cc:648] HybridClock initialized: now 1786335325980378 us; error 38 us; skew 500 ppm
Aug 10 04:15:25 dist-test-slave-0kls krb5kdc[30279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335325, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:25.982721 30532 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:15:25.983084 30532 webserver.cc:460] Webserver started at http://127.10.249.130:40865/ using document root <none> and password file <none>
I20260810 04:15:25.983304 30532 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:25.983343 30532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:25.983454 30532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:25.984380 30532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "93808c58ca6e4380b1ad0dabf3d54e0b"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "cee34ae88e565bf143d30adae8152b2d"
server_key_iv: "61f9d774b7779db2371569edbdc91686"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.984762 30532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "93808c58ca6e4380b1ad0dabf3d54e0b"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "cee34ae88e565bf143d30adae8152b2d"
server_key_iv: "61f9d774b7779db2371569edbdc91686"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.986251 30532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:15:25.986950 30548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:25.987121 30532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:25.987210 30532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "93808c58ca6e4380b1ad0dabf3d54e0b"
format_stamp: "Formatted at 2026-08-10 04:15:25 on dist-test-slave-0kls"
server_key: "cee34ae88e565bf143d30adae8152b2d"
server_key_iv: "61f9d774b7779db2371569edbdc91686"
server_key_version: "encryptionkey@0"
I20260810 04:15:25.987282 30532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:26.012269 30532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:26.014181 30532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:26.014339 30532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:26.014578 30532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:26.014905 30532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:26.014961 30532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.015002 30532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:26.015028 30532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.020656 30532 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:43415
I20260810 04:15:26.020727 30665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:43415 every 8 connection(s)
I20260810 04:15:26.021049 30532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:15:26 dist-test-slave-0kls krb5kdc[30279](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335325, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:26.027350 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 30532
I20260810 04:15:26.027479 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:15:26.027686 11238 external_mini_cluster.cc:1428] Setting key e4c960c2a47c71db69f920f0c23f0107
I20260810 04:15:26.030162 30379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.021837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:47369 (local address 127.10.249.190:37331)
0810 04:15:26.021889 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.021891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.022095 (+ 204us) server_negotiation.cc:407] Connection header received
0810 04:15:26.022531 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.022532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.022542 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.022648 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:26.023513 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.023988 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.024869 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.025036 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.025086 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.027172 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:26.027173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:26.027174 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:26.027179 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:26.028731 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:26.029137 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:26.029138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:26.029139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:26.029201 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:26.029450 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:26.029451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:26.029452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:26.029578 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:26.029652 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.030000 (+ 348us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.030077 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:15:26.030429 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.021770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37331 (local address 127.10.249.130:47369)
0810 04:15:26.021975 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.022011 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.022454 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.022703 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.022706 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.023253 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:26.023433 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.023439 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.024065 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.024066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.024802 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.024804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.025101 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.025102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.025193 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.025703 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:26.025711 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:26.027097 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:26.028814 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:26.028821 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:26.028824 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:26.029043 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:26.029268 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:26.029269 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:26.029270 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:26.029379 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:26.029655 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:26.029663 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:26.029864 (+ 201us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.029979 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.030129 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":98,"threads_started":1}
I20260810 04:15:26.030915 30666 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37331
I20260810 04:15:26.031013 30666 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:26.031175 30666 heartbeater.cc:511] Master 127.10.249.190:37331 requested a full tablet report, sending...
I20260810 04:15:26.031562 30326 ts_manager.cc:194] Registered new tserver with Master: 93808c58ca6e4380b1ad0dabf3d54e0b (127.10.249.130:43415)
I20260810 04:15:26.031950 30326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:47369
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:15:26.051920 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37331
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:41785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:26.130257 30671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:26.130446 30671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:26.130468 30671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:26.131445 30671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:26.131476 30671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:26.131500 30671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:15:26.132853 30671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:41785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:37331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:26.133036 30671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:26.133194 30671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:26.137918 30677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:26.137960 30671 server_base.cc:1034] running on GCE node
W20260810 04:15:26.137890 30678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:26.137897 30680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:26.138301 30671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:26.138540 30671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:26.139752 30671 hybrid_clock.cc:648] HybridClock initialized: now 1786335326139731 us; error 25 us; skew 500 ppm
Aug 10 04:15:26 dist-test-slave-0kls krb5kdc[30279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335326, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:26.142027 30671 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:15:26.142413 30671 webserver.cc:460] Webserver started at http://127.10.249.131:36287/ using document root <none> and password file <none>
I20260810 04:15:26.142617 30671 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:26.142681 30671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:26.142858 30671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:26.143805 30671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "f26245c32e4e4e71bd615e8b9996e74a"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "82fe13b05e16e53b050091034c50d23b"
server_key_iv: "5f77d013dce3389d8cae15ca92823408"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.144156 30671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "f26245c32e4e4e71bd615e8b9996e74a"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "82fe13b05e16e53b050091034c50d23b"
server_key_iv: "5f77d013dce3389d8cae15ca92823408"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.145447 30671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:26.146169 30687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.146350 30671 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.146467 30671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "f26245c32e4e4e71bd615e8b9996e74a"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "82fe13b05e16e53b050091034c50d23b"
server_key_iv: "5f77d013dce3389d8cae15ca92823408"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.146550 30671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:26.156791 30671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:26.158450 30671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:26.158617 30671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:26.158845 30671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:26.159133 30671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:26.159196 30671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.159238 30671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:26.159267 30671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.164851 30671 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:43861
I20260810 04:15:26.164881 30806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:43861 every 8 connection(s)
I20260810 04:15:26.165162 30671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:15:26.166483 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 30671
I20260810 04:15:26.166610 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:15:26.166805 11238 external_mini_cluster.cc:1428] Setting key a8d4399a743ccf112f2abb29667af811
Aug 10 04:15:26 dist-test-slave-0kls krb5kdc[30279](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335326, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:26.173532 30379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.165901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:49011 (local address 127.10.249.190:37331)
0810 04:15:26.165963 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.165965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.166169 (+ 204us) server_negotiation.cc:407] Connection header received
0810 04:15:26.166650 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.166652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.166666 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.166755 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:26.167869 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.168333 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.169279 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.169462 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.169515 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.171375 (+ 1860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:26.171376 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:26.171376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:26.171381 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:26.172448 (+ 1067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:26.172769 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:26.172770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:26.172770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:26.172816 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:26.173002 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:26.173003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:26.173003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:26.173110 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:26.173157 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.173411 (+ 254us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.173476 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:15:26.173588 30810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.165905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:37331 (local address 127.10.249.131:49011)
0810 04:15:26.166060 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.166091 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.166544 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.166801 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.166805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.167533 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:26.167783 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.167788 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.168423 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.168424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.169210 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.169212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.169534 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.169535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.169626 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.170121 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:26.170136 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:26.171306 (+ 1170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:26.172513 (+ 1207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:26.172518 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:26.172519 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:26.172709 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:26.172869 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:26.172870 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:26.172870 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:26.172954 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:26.173164 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:26.173168 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:26.173275 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.173346 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.173441 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260810 04:15:26.174041 30807 heartbeater.cc:347] Connected to a master server at 127.10.249.190:37331
I20260810 04:15:26.174113 30807 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:26.174271 30807 heartbeater.cc:511] Master 127.10.249.190:37331 requested a full tablet report, sending...
I20260810 04:15:26.174623 30326 ts_manager.cc:194] Registered new tserver with Master: f26245c32e4e4e71bd615e8b9996e74a (127.10.249.131:43861)
I20260810 04:15:26.174965 30326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:49011
I20260810 04:15:26.178369 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:15:26.186141 30379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.179740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44836 (local address 127.10.249.190:37331)
0810 04:15:26.179827 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.179829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.179930 (+ 101us) server_negotiation.cc:407] Connection header received
0810 04:15:26.179994 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.179995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.180004 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.180058 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:26.180617 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.181327 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.182271 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.182462 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.182551 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.183697 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:26.183698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:26.183698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:26.183705 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:26.184766 (+ 1061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:26.185200 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:26.185201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:26.185202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:26.185260 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:26.185502 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:26.185503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:26.185504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:26.185651 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:26.185767 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.185966 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.186039 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 04:15:26.187588 30326 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:15:26.189565 30326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:15:26.195598 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.191762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37907 (local address 127.0.0.1:34506)
0810 04:15:26.192419 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.192427 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.192471 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.192623 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.192624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.192626 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.192653 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.192655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.193885 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.193887 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.194638 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.194641 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.195336 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.195337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.195417 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.195430 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.195491 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.195538 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":44,"threads_started":1}
I20260810 04:15:26.195623 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.191942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34506 (local address 127.10.249.129:37907)
0810 04:15:26.192199 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.192202 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.192470 (+ 268us) server_negotiation.cc:407] Connection header received
0810 04:15:26.192531 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.192533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.192548 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.192618 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.192799 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.193751 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.194731 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.195252 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.195336 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.195389 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.195511 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.195555 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":108,"threads_started":1}
I20260810 04:15:26.195937 30817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.191761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:43861 (local address 127.0.0.1:44006)
0810 04:15:26.192300 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.192306 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.192355 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.192561 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.192562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.192564 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.192626 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.192627 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.193496 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.193497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.194793 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.194796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.195607 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.195608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.195778 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.195782 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.195828 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.195869 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":13,"thread_start_us":52,"threads_started":1}
I20260810 04:15:26.196010 30820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.191961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42192 (local address 127.10.249.130:43415)
0810 04:15:26.192124 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.192128 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.192225 (+ 97us) server_negotiation.cc:407] Connection header received
0810 04:15:26.192290 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.192292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.192304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.192393 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.192555 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.193541 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.194901 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.195480 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.195524 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.195570 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.195897 (+ 327us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.195942 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260810 04:15:26.195945 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.191759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:43415 (local address 127.0.0.1:42192)
0810 04:15:26.192120 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.192174 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.192238 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.192400 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.192403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.192406 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.192477 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.192479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.193666 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.193667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.194795 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.194796 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.195621 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.195622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.195816 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.195819 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.195865 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.195891 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":30,"spinlock_wait_cycles":384,"thread_start_us":55,"threads_started":1}
I20260810 04:15:26.196354 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.191959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44006 (local address 127.10.249.131:43861)
0810 04:15:26.192117 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.192122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.192357 (+ 235us) server_negotiation.cc:407] Connection header received
0810 04:15:26.192417 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.192419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.192435 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.192501 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.192708 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.193387 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.194893 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.195477 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.195538 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.195575 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.196264 (+ 689us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.196306 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260810 04:15:26.196285 30458 tablet_service.cc:1467] Processing CreateTablet for tablet 8337dc1d04d545d5908ee96ba7dc0f15 (DEFAULT_TABLE table=test-table [id=48c2ec7df16e4bc6ad9d05676534597e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:26.196614 30458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8337dc1d04d545d5908ee96ba7dc0f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:26.196704 30598 tablet_service.cc:1467] Processing CreateTablet for tablet 8337dc1d04d545d5908ee96ba7dc0f15 (DEFAULT_TABLE table=test-table [id=48c2ec7df16e4bc6ad9d05676534597e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:26.196938 30739 tablet_service.cc:1467] Processing CreateTablet for tablet 8337dc1d04d545d5908ee96ba7dc0f15 (DEFAULT_TABLE table=test-table [id=48c2ec7df16e4bc6ad9d05676534597e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:26.197024 30598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8337dc1d04d545d5908ee96ba7dc0f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:26.197225 30739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8337dc1d04d545d5908ee96ba7dc0f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:26.199555 30823 tablet_bootstrap.cc:492] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: Bootstrap starting.
I20260810 04:15:26.199934 30824 tablet_bootstrap.cc:492] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8: Bootstrap starting.
I20260810 04:15:26.200150 30825 tablet_bootstrap.cc:492] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: Bootstrap starting.
I20260810 04:15:26.200277 30823 tablet_bootstrap.cc:654] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:26.200780 30825 tablet_bootstrap.cc:654] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:26.200801 30824 tablet_bootstrap.cc:654] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:26.200872 30823 log.cc:824] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:26.201303 30825 log.cc:824] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:26.201442 30824 log.cc:824] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:26.201629 30823 tablet_bootstrap.cc:492] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: No bootstrap required, opened a new log
I20260810 04:15:26.201701 30823 ts_tablet_manager.cc:1397] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:15:26.202006 30825 tablet_bootstrap.cc:492] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: No bootstrap required, opened a new log
I20260810 04:15:26.202054 30825 ts_tablet_manager.cc:1397] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:15:26.202917 30823 raft_consensus.cc:348] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.203058 30823 raft_consensus.cc:374] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:26.203096 30823 raft_consensus.cc:729] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26245c32e4e4e71bd615e8b9996e74a, State: Initialized, Role: FOLLOWER
I20260810 04:15:26.203213 30823 consensus_queue.cc:260] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.203277 30825 raft_consensus.cc:348] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.203491 30825 raft_consensus.cc:374] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:26.203504 30823 ts_tablet_manager.cc:1428] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:15:26.203522 30807 heartbeater.cc:503] Master 127.10.249.190:37331 was elected leader, sending a full tablet report...
I20260810 04:15:26.203536 30825 raft_consensus.cc:729] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93808c58ca6e4380b1ad0dabf3d54e0b, State: Initialized, Role: FOLLOWER
I20260810 04:15:26.203639 30825 consensus_queue.cc:260] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.203902 30825 ts_tablet_manager.cc:1428] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:15:26.203927 30666 heartbeater.cc:503] Master 127.10.249.190:37331 was elected leader, sending a full tablet report...
I20260810 04:15:26.204383 30824 tablet_bootstrap.cc:492] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8: No bootstrap required, opened a new log
I20260810 04:15:26.204445 30824 ts_tablet_manager.cc:1397] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 04:15:26.205746 30824 raft_consensus.cc:348] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.205941 30824 raft_consensus.cc:374] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:26.205983 30824 raft_consensus.cc:729] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d0fb9a98464e9882166efd7f6bcde8, State: Initialized, Role: FOLLOWER
I20260810 04:15:26.206081 30824 consensus_queue.cc:260] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.206316 30824 ts_tablet_manager.cc:1428] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:15:26.206349 30527 heartbeater.cc:503] Master 127.10.249.190:37331 was elected leader, sending a full tablet report...
I20260810 04:15:26.208478 30829 raft_consensus.cc:482] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:26.208554 30829 raft_consensus.cc:504] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.208854 30829 leader_election.cc:288] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93808c58ca6e4380b1ad0dabf3d54e0b (127.10.249.130:43415), 21d0fb9a98464e9882166efd7f6bcde8 (127.10.249.129:37907)
I20260810 04:15:26.212237 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.209273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:36105 (local address 127.10.249.129:37907)
0810 04:15:26.209315 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.209317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.209324 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:15:26.209343 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.209344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.209353 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.209406 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.209542 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.210180 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.211411 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.211914 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.211983 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.211990 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.212138 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.212171 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:15:26.212237 30820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.209031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:32915 (local address 127.10.249.130:43415)
0810 04:15:26.209079 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.209081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.209131 (+ 50us) server_negotiation.cc:407] Connection header received
0810 04:15:26.209207 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.209208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.209217 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.209267 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.209444 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.210137 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.211410 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.211911 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.211983 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.211990 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.212138 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.212174 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:15:26.212250 30810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.208968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:43415 (local address 127.10.249.131:32915)
0810 04:15:26.209082 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.209095 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.209143 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.209310 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.209311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.209312 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.209371 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.209372 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.210227 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.210228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.211327 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.211330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.211992 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.211993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.212067 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.212069 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.212121 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.212165 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":34}
I20260810 04:15:26.212260 30832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.209011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37907 (local address 127.10.249.131:36105)
0810 04:15:26.209156 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.209166 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.209216 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.209420 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.209420 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.209422 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.209474 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.209476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.210240 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.210240 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.211327 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.211330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.211992 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.211993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.212064 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.212068 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.212121 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.212165 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":53,"thread_start_us":80,"threads_started":1}
I20260810 04:15:26.212556 30479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8337dc1d04d545d5908ee96ba7dc0f15" candidate_uuid: "f26245c32e4e4e71bd615e8b9996e74a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d0fb9a98464e9882166efd7f6bcde8" is_pre_election: true
I20260810 04:15:26.212685 30479 raft_consensus.cc:2454] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26245c32e4e4e71bd615e8b9996e74a in term 0.
I20260810 04:15:26.212684 30619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8337dc1d04d545d5908ee96ba7dc0f15" candidate_uuid: "f26245c32e4e4e71bd615e8b9996e74a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" is_pre_election: true
I20260810 04:15:26.212785 30619 raft_consensus.cc:2454] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26245c32e4e4e71bd615e8b9996e74a in term 0.
I20260810 04:15:26.212879 30690 leader_election.cc:302] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d0fb9a98464e9882166efd7f6bcde8, f26245c32e4e4e71bd615e8b9996e74a; no voters:
I20260810 04:15:26.212977 30829 raft_consensus.cc:2781] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:15:26.213023 30829 raft_consensus.cc:482] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:15:26.213048 30829 raft_consensus.cc:3037] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:26.213632 30829 raft_consensus.cc:504] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.213773 30829 leader_election.cc:288] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [CANDIDATE]: Term 1 election: Requested vote from peers 93808c58ca6e4380b1ad0dabf3d54e0b (127.10.249.130:43415), 21d0fb9a98464e9882166efd7f6bcde8 (127.10.249.129:37907)
I20260810 04:15:26.213943 30619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8337dc1d04d545d5908ee96ba7dc0f15" candidate_uuid: "f26245c32e4e4e71bd615e8b9996e74a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b"
I20260810 04:15:26.213975 30479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8337dc1d04d545d5908ee96ba7dc0f15" candidate_uuid: "f26245c32e4e4e71bd615e8b9996e74a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d0fb9a98464e9882166efd7f6bcde8"
I20260810 04:15:26.214020 30619 raft_consensus.cc:3037] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:26.214033 30479 raft_consensus.cc:3037] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:26.214818 30479 raft_consensus.cc:2454] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26245c32e4e4e71bd615e8b9996e74a in term 1.
I20260810 04:15:26.214818 30619 raft_consensus.cc:2454] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26245c32e4e4e71bd615e8b9996e74a in term 1.
I20260810 04:15:26.214989 30690 leader_election.cc:302] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d0fb9a98464e9882166efd7f6bcde8, f26245c32e4e4e71bd615e8b9996e74a; no voters:
I20260810 04:15:26.215101 30829 raft_consensus.cc:2781] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:26.215236 30829 raft_consensus.cc:686] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 1 LEADER]: Becoming Leader. State: Replica: f26245c32e4e4e71bd615e8b9996e74a, State: Running, Role: LEADER
I20260810 04:15:26.215330 30829 consensus_queue.cc:237] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } }
I20260810 04:15:26.215978 30325 catalog_manager.cc:5495] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a reported cstate change: term changed from 0 to 1, leader changed from <none> to f26245c32e4e4e71bd615e8b9996e74a (127.10.249.131). New cstate: current_term: 1 leader_uuid: "f26245c32e4e4e71bd615e8b9996e74a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26245c32e4e4e71bd615e8b9996e74a" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43861 } health_report { overall_health: HEALTHY } } }
I20260810 04:15:26.226172 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.224295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44010 (local address 127.10.249.131:43861)
0810 04:15:26.224342 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.224344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.224351 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:15:26.224374 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.224374 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.224387 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.224436 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:26.224550 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.224930 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.225531 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.225678 (+ 147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.225719 (+ 41us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.225898 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:26.225969 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:26.226033 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.226072 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.226080 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:15:26.227600 30479 raft_consensus.cc:1261] T 8337dc1d04d545d5908ee96ba7dc0f15 P 21d0fb9a98464e9882166efd7f6bcde8 [term 1 FOLLOWER]: Refusing update from remote peer f26245c32e4e4e71bd615e8b9996e74a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:26.227617 30619 raft_consensus.cc:1261] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 1 FOLLOWER]: Refusing update from remote peer f26245c32e4e4e71bd615e8b9996e74a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:26.227949 30833 consensus_queue.cc:1035] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d0fb9a98464e9882166efd7f6bcde8" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:26.228050 30829 consensus_queue.cc:1035] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93808c58ca6e4380b1ad0dabf3d54e0b" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 43415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:26.230507 30836 mvcc.cc:205] Tried to move back new op lower bound from 7316829496226185216 to 7316829496178688000. Current Snapshot: MvccSnapshot[applied={T|T < 7316829496226185216}]
I20260810 04:15:26.232755 30326 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:26.232861 30326 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:26.233603 30326 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5c7e5bef2d0e4ccab30a19899a6cd174: Sending DeleteTablet for 3 replicas of tablet 8337dc1d04d545d5908ee96ba7dc0f15
I20260810 04:15:26.233938 30458 tablet_service.cc:1514] Processing DeleteTablet for tablet 8337dc1d04d545d5908ee96ba7dc0f15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:26 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:34506
I20260810 04:15:26.234086 30598 tablet_service.cc:1514] Processing DeleteTablet for tablet 8337dc1d04d545d5908ee96ba7dc0f15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:26 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:42192
I20260810 04:15:26.234153 30739 tablet_service.cc:1514] Processing DeleteTablet for tablet 8337dc1d04d545d5908ee96ba7dc0f15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:26 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:44006
I20260810 04:15:26.234287 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 30393
I20260810 04:15:26.234315 30848 tablet_replica.cc:330] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: stopping tablet replica
I20260810 04:15:26.234411 30848 raft_consensus.cc:2229] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:15:26.234512 30848 raft_consensus.cc:2258] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:26.236289 30849 tablet_replica.cc:330] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: stopping tablet replica
I20260810 04:15:26.236402 30849 raft_consensus.cc:2229] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:15:26.236531 30849 raft_consensus.cc:2258] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:26.237013 30849 ts_tablet_manager.cc:1905] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:26.237329 30848 ts_tablet_manager.cc:1905] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:26.238852 30849 ts_tablet_manager.cc:1918] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:26.238937 30849 log.cc:1196] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/8337dc1d04d545d5908ee96ba7dc0f15
I20260810 04:15:26.239199 30849 ts_tablet_manager.cc:1939] T 8337dc1d04d545d5908ee96ba7dc0f15 P f26245c32e4e4e71bd615e8b9996e74a: Deleting consensus metadata
I20260810 04:15:26.239394 30848 ts_tablet_manager.cc:1918] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:26.239491 30848 log.cc:1196] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/8337dc1d04d545d5908ee96ba7dc0f15
I20260810 04:15:26.239588 30313 catalog_manager.cc:4841] TS f26245c32e4e4e71bd615e8b9996e74a (127.10.249.131:43861): tablet 8337dc1d04d545d5908ee96ba7dc0f15 (table test-table [id=48c2ec7df16e4bc6ad9d05676534597e]) successfully deleted
I20260810 04:15:26.239866 30848 ts_tablet_manager.cc:1939] T 8337dc1d04d545d5908ee96ba7dc0f15 P 93808c58ca6e4380b1ad0dabf3d54e0b: Deleting consensus metadata
I20260810 04:15:26.240322 30310 catalog_manager.cc:4841] TS 93808c58ca6e4380b1ad0dabf3d54e0b (127.10.249.130:43415): tablet 8337dc1d04d545d5908ee96ba7dc0f15 (table test-table [id=48c2ec7df16e4bc6ad9d05676534597e]) successfully deleted
W20260810 04:15:26.247097 30312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:37907 (error 108)
I20260810 04:15:26.247411 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 30532
I20260810 04:15:26.247555 30817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.247424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37907 (local address 127.0.0.1:34510)
0810 04:15:26.247483 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.247523 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:37907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 04:15:26.251438 30312 catalog_manager.cc:4584] TS 21d0fb9a98464e9882166efd7f6bcde8 (127.10.249.129:37907): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8337dc1d04d545d5908ee96ba7dc0f15: Network error: Client connection negotiation failed: client connection to 127.10.249.129:37907: connect: Connection refused (error 111)
I20260810 04:15:26.254733 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 30671
I20260810 04:15:26.260134 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 30294
2026-08-10T04:15:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1821 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T04:15:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:26Z Disabled control of system clock
I20260810 04:15:26.287875 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:34955
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:44153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:34955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:26.362077 30854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:26.362275 30854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:26.362293 30854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:26.363241 30854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:26.363273 30854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:26.363286 30854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:26.363296 30854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:26.363307 30854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:26.364408 30854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:34955
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:34955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:26.364567 30854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:26.364771 30854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:26.369061 30860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:26.369077 30859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:26.369107 30854 server_base.cc:1034] running on GCE node
W20260810 04:15:26.369089 30862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:26.369488 30854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:26.369717 30854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:26.370899 30854 hybrid_clock.cc:648] HybridClock initialized: now 1786335326370911 us; error 50 us; skew 500 ppm
I20260810 04:15:26.372057 30854 webserver.cc:460] Webserver started at http://127.10.249.190:37493/ using document root <none> and password file <none>
I20260810 04:15:26.372335 30854 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:26.372398 30854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:26.372519 30854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:26.373472 30854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "18172ee01642410d921c2c0aef4c0429"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "70d2af37c6a57c5bf3cff315e35c9287"
server_key_iv: "ef0a354093c2b0b357981f98c80f152a"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.373920 30854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "18172ee01642410d921c2c0aef4c0429"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "70d2af37c6a57c5bf3cff315e35c9287"
server_key_iv: "ef0a354093c2b0b357981f98c80f152a"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.375171 30854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:15:26.375825 30868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.375988 30854 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:15:26.376109 30854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "18172ee01642410d921c2c0aef4c0429"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "70d2af37c6a57c5bf3cff315e35c9287"
server_key_iv: "ef0a354093c2b0b357981f98c80f152a"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.376214 30854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:26.386668 30854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:26.386914 30854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:26.387049 30854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:26.390947 30854 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:34955
I20260810 04:15:26.390973 30924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:34955 every 8 connection(s)
I20260810 04:15:26.391265 30854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:26.391777 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 30854
I20260810 04:15:26.391876 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:26.392082 11238 external_mini_cluster.cc:1428] Setting key 5af8851dec8f5671d9e5d93fc976b8ad
I20260810 04:15:26.392441 30925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:26.395352 30925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429: Bootstrap starting.
I20260810 04:15:26.395939 30925 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:26.396255 30925 log.cc:824] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:26.396976 30925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429: No bootstrap required, opened a new log
I20260810 04:15:26.397500 30928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.392571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33400 (local address 127.10.249.190:34955)
0810 04:15:26.392774 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.392780 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.392802 (+ 22us) server_negotiation.cc:407] Connection header received
0810 04:15:26.393395 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.393401 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.393456 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.393560 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:26.393850 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.394703 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.395728 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.396120 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.396202 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.396838 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:26.396841 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:26.396842 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:26.396972 (+ 130us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:26.396999 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:26.397031 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:26.397089 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.397177 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.397263 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":100,"threads_started":1}
I20260810 04:15:26.398909 30925 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18172ee01642410d921c2c0aef4c0429" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34955 } }
I20260810 04:15:26.399030 30925 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:26.399052 30925 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18172ee01642410d921c2c0aef4c0429, State: Initialized, Role: FOLLOWER
I20260810 04:15:26.399128 30925 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18172ee01642410d921c2c0aef4c0429" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34955 } }
I20260810 04:15:26.399180 30925 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:26.399200 30925 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:26.399226 30925 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:26.399734 30925 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18172ee01642410d921c2c0aef4c0429" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34955 } }
I20260810 04:15:26.399834 30925 leader_election.cc:302] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18172ee01642410d921c2c0aef4c0429; no voters:
I20260810 04:15:26.399960 30925 leader_election.cc:288] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:26.400013 30930 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:26.400154 30930 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [term 1 LEADER]: Becoming Leader. State: Replica: 18172ee01642410d921c2c0aef4c0429, State: Running, Role: LEADER
I20260810 04:15:26.400209 30925 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:26.400243 30930 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18172ee01642410d921c2c0aef4c0429" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34955 } }
I20260810 04:15:26.400593 30931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18172ee01642410d921c2c0aef4c0429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18172ee01642410d921c2c0aef4c0429" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34955 } } }
I20260810 04:15:26.400629 30932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18172ee01642410d921c2c0aef4c0429. Latest consensus state: current_term: 1 leader_uuid: "18172ee01642410d921c2c0aef4c0429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18172ee01642410d921c2c0aef4c0429" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34955 } } }
I20260810 04:15:26.400769 30931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:26.400787 30932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429 [sys.catalog]: This master's current role is: LEADER
W20260810 04:15:26.401881 30946 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:26.401923 30946 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:26.401988 30939 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:26.402196 30939 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:26.403594 30939 catalog_manager.cc:1347] Generated new cluster ID: 184ca5f8920c4538b4d6d4d931ebfdc8
I20260810 04:15:26.403684 30939 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:26.415721 30939 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:26.416141 30939 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:26.417577 30939 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429: Generated new TSK 0
I20260810 04:15:26.417721 30939 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:26.419822 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34955
--builtin_ntp_servers=127.10.249.148:44153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:26.495715 30949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:26.495909 30949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:26.495950 30949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:26.497068 30949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:26.497107 30949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:26.497144 30949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:15:26.498538 30949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:26.498781 30949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:26.499087 30949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:26.504395 30956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:26.504549 30949 server_base.cc:1034] running on GCE node
W20260810 04:15:26.504630 30958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:26.504736 30954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:26.504910 30949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:26.505152 30949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:26.506316 30949 hybrid_clock.cc:648] HybridClock initialized: now 1786335326506301 us; error 31 us; skew 500 ppm
I20260810 04:15:26.507632 30949 webserver.cc:460] Webserver started at http://127.10.249.129:44587/ using document root <none> and password file <none>
I20260810 04:15:26.507854 30949 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:26.507915 30949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:26.508057 30949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:26.509078 30949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "0d8116394a5e4d4f9c4cfed82b799926"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "5ebe4262a6577fa221429a85a45009ed"
server_key_iv: "88f2390f0b27673fb3dcc8175172d7be"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.509449 30949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "0d8116394a5e4d4f9c4cfed82b799926"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "5ebe4262a6577fa221429a85a45009ed"
server_key_iv: "88f2390f0b27673fb3dcc8175172d7be"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.511041 30949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:26.511809 30965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.512005 30949 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:26.512094 30949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "0d8116394a5e4d4f9c4cfed82b799926"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "5ebe4262a6577fa221429a85a45009ed"
server_key_iv: "88f2390f0b27673fb3dcc8175172d7be"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.512154 30949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:26.540966 30949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:26.541210 30949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:26.541306 30949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:26.541460 30949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:26.541702 30949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:26.541729 30949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.541749 30949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:26.541762 30949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.546988 30949 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:37773
I20260810 04:15:26.547060 31082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:37773 every 8 connection(s)
I20260810 04:15:26.547338 30949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:15:26.552575 30928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.548018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:58057 (local address 127.10.249.190:34955)
0810 04:15:26.548063 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.548065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.548302 (+ 237us) server_negotiation.cc:407] Connection header received
0810 04:15:26.548834 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.548836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.548852 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.548907 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:26.549580 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.550113 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.551166 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.551367 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.551446 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.552267 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:26.552268 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:26.552269 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:26.552274 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:26.552290 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:26.552294 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:26.552358 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.552467 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.552495 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:15:26.552804 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.548005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34955 (local address 127.10.249.129:58057)
0810 04:15:26.548190 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.548219 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.548710 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.548971 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.548975 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.548985 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:26.549465 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.549470 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.550230 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.550231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.551067 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.551069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.551457 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.551459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.551596 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.552121 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:26.552121 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:26.552149 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:26.552171 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:26.552375 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:26.552382 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:26.552384 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.552466 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.552565 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":80,"threads_started":1}
I20260810 04:15:26.553333 31083 heartbeater.cc:347] Connected to a master server at 127.10.249.190:34955
I20260810 04:15:26.553541 31083 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:26.553730 31083 heartbeater.cc:511] Master 127.10.249.190:34955 requested a full tablet report, sending...
I20260810 04:15:26.554245 30887 ts_manager.cc:194] Registered new tserver with Master: 0d8116394a5e4d4f9c4cfed82b799926 (127.10.249.129:37773)
I20260810 04:15:26.554816 30887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.129:58057
I20260810 04:15:26.555181 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 30949
I20260810 04:15:26.555306 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:15:26.555492 11238 external_mini_cluster.cc:1428] Setting key 749468488c7d55880b68b0af8e7a23c7
I20260810 04:15:26.556334 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34955
--builtin_ntp_servers=127.10.249.148:44153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:26.632122 31086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:26.632313 31086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:26.632333 31086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:26.633399 31086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:26.633435 31086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:26.633456 31086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:15:26.634768 31086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:26.634986 31086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:26.635248 31086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:26.639963 31091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:26.639976 31092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:26.639993 31094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:26.640280 31086 server_base.cc:1034] running on GCE node
I20260810 04:15:26.640475 31086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:26.640666 31086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:26.641824 31086 hybrid_clock.cc:648] HybridClock initialized: now 1786335326641811 us; error 25 us; skew 500 ppm
I20260810 04:15:26.642915 31086 webserver.cc:460] Webserver started at http://127.10.249.130:46843/ using document root <none> and password file <none>
I20260810 04:15:26.643123 31086 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:26.643165 31086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:26.643293 31086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:26.644192 31086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "c7de93bb105a4923b4bd6edb57e2f816"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "7c07880a99f506fff33872ef5b7572d6"
server_key_iv: "a8c3a29bf0d79977b261cd303a6834f5"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.644506 31086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "c7de93bb105a4923b4bd6edb57e2f816"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "7c07880a99f506fff33872ef5b7572d6"
server_key_iv: "a8c3a29bf0d79977b261cd303a6834f5"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.645607 31086 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:15:26.646296 31100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.646448 31086 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.646556 31086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "c7de93bb105a4923b4bd6edb57e2f816"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "7c07880a99f506fff33872ef5b7572d6"
server_key_iv: "a8c3a29bf0d79977b261cd303a6834f5"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.646631 31086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:26.666780 31086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:26.667035 31086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:26.667174 31086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:26.667402 31086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:26.667707 31086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:26.667761 31086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.667804 31086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:26.667829 31086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.673283 31086 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:42349
I20260810 04:15:26.673334 31221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:42349 every 8 connection(s)
I20260810 04:15:26.673595 31086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:15:26.678288 30928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.674272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:51213 (local address 127.10.249.190:34955)
0810 04:15:26.674318 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.674320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.674565 (+ 245us) server_negotiation.cc:407] Connection header received
0810 04:15:26.675010 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.675012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.675023 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.675070 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:26.675652 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.676078 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.676979 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.677165 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.677244 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.677999 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:26.678001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:26.678001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:26.678007 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:26.678021 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:26.678026 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:26.678089 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.678191 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.678216 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:15:26.678467 31225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.674256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34955 (local address 127.10.249.130:51213)
0810 04:15:26.674447 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.674475 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.674917 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.675125 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.675129 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.675137 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:26.675564 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.675568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.676167 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.676168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.676884 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.676886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.677254 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.677255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.677377 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.677867 (+ 490us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:26.677867 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:26.677893 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:26.677912 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:26.678092 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:26.678098 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:26.678101 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.678183 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.678273 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260810 04:15:26.679004 31222 heartbeater.cc:347] Connected to a master server at 127.10.249.190:34955
I20260810 04:15:26.679092 31222 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:26.679224 31222 heartbeater.cc:511] Master 127.10.249.190:34955 requested a full tablet report, sending...
I20260810 04:15:26.679553 30887 ts_manager.cc:194] Registered new tserver with Master: c7de93bb105a4923b4bd6edb57e2f816 (127.10.249.130:42349)
I20260810 04:15:26.679943 30887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.130:51213
I20260810 04:15:26.681342 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 31086
I20260810 04:15:26.681428 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:15:26.681572 11238 external_mini_cluster.cc:1428] Setting key 562da220b3df2cd5d91258c5715f58fc
I20260810 04:15:26.682420 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34955
--builtin_ntp_servers=127.10.249.148:44153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:26.759639 31226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:26.759871 31226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:26.759912 31226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:26.761054 31226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:26.761117 31226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:26.761158 31226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:15:26.762383 31226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:44153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:26.762620 31226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:26.762889 31226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:26.767347 31231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:26.767382 31234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:26.767376 31232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:26.767776 31226 server_base.cc:1034] running on GCE node
I20260810 04:15:26.768062 31226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:26.768311 31226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:26.769459 31226 hybrid_clock.cc:648] HybridClock initialized: now 1786335326769440 us; error 34 us; skew 500 ppm
I20260810 04:15:26.771014 31226 webserver.cc:460] Webserver started at http://127.10.249.131:44049/ using document root <none> and password file <none>
I20260810 04:15:26.771291 31226 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:26.771339 31226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:26.771507 31226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:26.772480 31226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "01f4ab5c3a104d909dd670f657e30e57"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "7458268fa8d11e29e39fe061a21c585f"
server_key_iv: "338c327eeddbc7e0f32b84458aa3c52b"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.772814 31226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "01f4ab5c3a104d909dd670f657e30e57"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "7458268fa8d11e29e39fe061a21c585f"
server_key_iv: "338c327eeddbc7e0f32b84458aa3c52b"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.774144 31226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:15:26.774816 31240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.774983 31226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:15:26.775085 31226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "01f4ab5c3a104d909dd670f657e30e57"
format_stamp: "Formatted at 2026-08-10 04:15:26 on dist-test-slave-0kls"
server_key: "7458268fa8d11e29e39fe061a21c585f"
server_key_iv: "338c327eeddbc7e0f32b84458aa3c52b"
server_key_version: "encryptionkey@0"
I20260810 04:15:26.775166 31226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:26.787436 31226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:26.787684 31226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:26.787827 31226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:26.788020 31226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:26.788298 31226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:26.788348 31226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.788383 31226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:26.788407 31226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:26.794029 31226 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:41747
I20260810 04:15:26.794067 31361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:41747 every 8 connection(s)
I20260810 04:15:26.794328 31226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:15:26.797262 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 31226
I20260810 04:15:26.797369 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:15:26.797575 11238 external_mini_cluster.cc:1428] Setting key 5e720ca582fb3403c9b5ca4b88367275
I20260810 04:15:26.798857 30928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.794895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:47249 (local address 127.10.249.190:34955)
0810 04:15:26.794935 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.794937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.795132 (+ 195us) server_negotiation.cc:407] Connection header received
0810 04:15:26.795540 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.795540 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.795550 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.795602 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:26.796182 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.796613 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.797442 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.797719 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.797860 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.798660 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:26.798661 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:26.798661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:26.798666 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:26.798683 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:26.798687 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:26.798731 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.798778 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.798802 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:15:26.799049 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.794868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34955 (local address 127.10.249.131:47249)
0810 04:15:26.795028 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.795063 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.795468 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.795680 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.795683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.795690 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:26.796117 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.796121 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.796682 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.796683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.797319 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.797321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.797827 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.797828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.797960 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.798520 (+ 560us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:26.798521 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:26.798544 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:26.798564 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:26.798731 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:26.798733 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:26.798735 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.798779 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.798848 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260810 04:15:26.799487 31362 heartbeater.cc:347] Connected to a master server at 127.10.249.190:34955
I20260810 04:15:26.799577 31362 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:26.799774 31362 heartbeater.cc:511] Master 127.10.249.190:34955 requested a full tablet report, sending...
I20260810 04:15:26.800139 30887 ts_manager.cc:194] Registered new tserver with Master: 01f4ab5c3a104d909dd670f657e30e57 (127.10.249.131:41747)
I20260810 04:15:26.800547 30887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.131:47249
I20260810 04:15:26.809401 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:15:26.812978 30928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.810726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33414 (local address 127.10.249.190:34955)
0810 04:15:26.810786 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.810788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.810888 (+ 100us) server_negotiation.cc:407] Connection header received
0810 04:15:26.810920 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.810920 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.810928 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.810958 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:26.811073 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.811449 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.812045 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.812195 (+ 150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.812235 (+ 40us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.812710 (+ 475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:26.812711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:26.812711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:26.812715 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:26.812726 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:26.812729 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:26.812797 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.812866 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.812893 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:15:26.814394 30887 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:15:26.815840 30887 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:15:26.821713 31373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.818017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:42349 (local address 127.0.0.1:43482)
0810 04:15:26.818272 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.818280 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.818320 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.818483 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.818484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.818488 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.818546 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.818547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.819864 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.819865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.820770 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.820773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.821517 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.821518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.821568 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.821578 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.821627 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.821660 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":1,"thread_start_us":61,"threads_started":1}
I20260810 04:15:26.821930 31375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.818117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43482 (local address 127.10.249.130:42349)
0810 04:15:26.818333 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.818336 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.818344 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:15:26.818377 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.818380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.818393 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.818464 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.818663 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.819778 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.820833 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.821440 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.821511 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.821582 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.821640 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.821678 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":109,"threads_started":1}
I20260810 04:15:26.822748 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.817829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:41747 (local address 127.0.0.1:59750)
0810 04:15:26.818095 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.818105 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.818165 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.818481 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.818484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.818486 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.818546 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.818547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.819840 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.819841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.821031 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.821034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.822583 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.822584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.822629 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.822632 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.822670 (+ 38us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.822705 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":14,"thread_start_us":79,"threads_started":1}
I20260810 04:15:26.822786 31374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.818130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59750 (local address 127.10.249.131:41747)
0810 04:15:26.818292 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.818296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.818306 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:15:26.818340 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.818343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.818357 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.818437 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.818648 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.819739 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.821829 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.822500 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.822577 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.822661 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.822686 (+ 25us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.822720 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260810 04:15:26.822667 31150 tablet_service.cc:1467] Processing CreateTablet for tablet d79031c62c6f48df83735e91df7e9bf4 (DEFAULT_TABLE table=test-table [id=b61f0bbc2cd4465e9ab643a99dfb7194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:26.823048 31150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d79031c62c6f48df83735e91df7e9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:26.823367 31292 tablet_service.cc:1467] Processing CreateTablet for tablet d79031c62c6f48df83735e91df7e9bf4 (DEFAULT_TABLE table=test-table [id=b61f0bbc2cd4465e9ab643a99dfb7194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:26.823633 31292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d79031c62c6f48df83735e91df7e9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:26.825340 31376 tablet_bootstrap.cc:492] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Bootstrap starting.
I20260810 04:15:26.825734 31377 tablet_bootstrap.cc:492] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57: Bootstrap starting.
I20260810 04:15:26.825922 31376 tablet_bootstrap.cc:654] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:26.826236 31376 log.cc:824] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:26.826267 31371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.817815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37773 (local address 127.0.0.1:35346)
0810 04:15:26.817954 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.817986 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.818047 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.818791 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.818792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.818795 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.818839 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.818840 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.819721 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.819722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.821031 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.821034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.826016 (+ 4982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.826017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.826083 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.826087 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.826140 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.826206 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":30,"thread_start_us":57,"threads_started":1}
I20260810 04:15:26.826309 31372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.817921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35346 (local address 127.10.249.129:37773)
0810 04:15:26.818583 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.818587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.818596 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:15:26.818652 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.818654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.818668 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.818912 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.818970 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.819623 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.821121 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.822927 (+ 1806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.822994 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.823074 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.826163 (+ 3089us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.826229 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":83,"threads_started":1}
I20260810 04:15:26.826656 31377 tablet_bootstrap.cc:654] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:26.826930 31377 log.cc:824] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:26.826946 31376 tablet_bootstrap.cc:492] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: No bootstrap required, opened a new log
I20260810 04:15:26.826905 31016 tablet_service.cc:1467] Processing CreateTablet for tablet d79031c62c6f48df83735e91df7e9bf4 (DEFAULT_TABLE table=test-table [id=b61f0bbc2cd4465e9ab643a99dfb7194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:26.827013 31376 ts_tablet_manager.cc:1397] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:15:26.827211 31016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d79031c62c6f48df83735e91df7e9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:26.827540 31377 tablet_bootstrap.cc:492] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57: No bootstrap required, opened a new log
I20260810 04:15:26.827617 31377 ts_tablet_manager.cc:1397] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:15:26.829416 31377 raft_consensus.cc:348] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.829564 31377 raft_consensus.cc:374] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:26.829608 31377 raft_consensus.cc:729] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01f4ab5c3a104d909dd670f657e30e57, State: Initialized, Role: FOLLOWER
I20260810 04:15:26.829581 31376 raft_consensus.cc:348] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.829733 31376 raft_consensus.cc:374] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:26.829773 31376 raft_consensus.cc:729] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7de93bb105a4923b4bd6edb57e2f816, State: Initialized, Role: FOLLOWER
I20260810 04:15:26.829734 31377 consensus_queue.cc:260] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.829946 31376 consensus_queue.cc:260] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.830108 31377 ts_tablet_manager.cc:1428] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:15:26.830159 31362 heartbeater.cc:503] Master 127.10.249.190:34955 was elected leader, sending a full tablet report...
I20260810 04:15:26.830215 31376 ts_tablet_manager.cc:1428] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:15:26.830339 31222 heartbeater.cc:503] Master 127.10.249.190:34955 was elected leader, sending a full tablet report...
I20260810 04:15:26.830435 31382 tablet_bootstrap.cc:492] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926: Bootstrap starting.
I20260810 04:15:26.831007 31382 tablet_bootstrap.cc:654] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:26.831346 31382 log.cc:824] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:26.831878 31382 tablet_bootstrap.cc:492] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926: No bootstrap required, opened a new log
I20260810 04:15:26.831923 31382 ts_tablet_manager.cc:1397] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:15:26.833482 31382 raft_consensus.cc:348] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.833601 31382 raft_consensus.cc:374] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:26.833621 31382 raft_consensus.cc:729] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d8116394a5e4d4f9c4cfed82b799926, State: Initialized, Role: FOLLOWER
I20260810 04:15:26.833748 31382 consensus_queue.cc:260] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.833985 31382 ts_tablet_manager.cc:1428] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:15:26.834043 31083 heartbeater.cc:503] Master 127.10.249.190:34955 was elected leader, sending a full tablet report...
W20260810 04:15:26.924218 31223 tablet.cc:2369] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:15:26.977986 31380 raft_consensus.cc:482] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:26.978147 31380 raft_consensus.cc:504] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.978505 31380 leader_election.cc:288] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d8116394a5e4d4f9c4cfed82b799926 (127.10.249.129:37773), c7de93bb105a4923b4bd6edb57e2f816 (127.10.249.130:42349)
I20260810 04:15:26.981442 31372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.978820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:37863 (local address 127.10.249.129:37773)
0810 04:15:26.978873 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.978875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.978910 (+ 35us) server_negotiation.cc:407] Connection header received
0810 04:15:26.978940 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.978941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.978952 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.979001 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.979213 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.979823 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.980748 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.981107 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.981199 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.981207 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.981346 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.981383 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 04:15:26.981442 31364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.978716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37773 (local address 127.10.249.131:37863)
0810 04:15:26.978775 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.978787 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.978869 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.979058 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.979059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.979060 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.979115 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.979117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.979902 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.979903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.980644 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.980657 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.981199 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.981200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.981262 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.981264 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.981338 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.981375 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":5}
I20260810 04:15:26.981709 31385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.978830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:42349 (local address 127.10.249.131:54043)
0810 04:15:26.979035 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:26.979050 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:26.979112 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:26.979261 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:26.979262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:26.979264 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:26.979356 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.979358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.980060 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.980061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.980891 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:26.980893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.981402 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.981403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:26.981493 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.981495 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:26.981580 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 04:15:26.981623 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":131,"threads_started":1}
I20260810 04:15:26.981906 31375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:26.978928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:54043 (local address 127.10.249.130:42349)
0810 04:15:26.978972 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:26.978974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:26.979101 (+ 127us) server_negotiation.cc:407] Connection header received
0810 04:15:26.979178 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:26.979179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:26.979188 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:26.979256 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:26.979425 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.979977 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.980992 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:26.981325 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:26.981401 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:26.981409 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:26.981748 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 04:15:26.981834 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:15:26.981873 31036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d79031c62c6f48df83735e91df7e9bf4" candidate_uuid: "01f4ab5c3a104d909dd670f657e30e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d8116394a5e4d4f9c4cfed82b799926" is_pre_election: true
I20260810 04:15:26.982002 31036 raft_consensus.cc:2454] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01f4ab5c3a104d909dd670f657e30e57 in term 0.
I20260810 04:15:26.982220 31242 leader_election.cc:302] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01f4ab5c3a104d909dd670f657e30e57, 0d8116394a5e4d4f9c4cfed82b799926; no voters:
I20260810 04:15:26.982296 31171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d79031c62c6f48df83735e91df7e9bf4" candidate_uuid: "01f4ab5c3a104d909dd670f657e30e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7de93bb105a4923b4bd6edb57e2f816" is_pre_election: true
I20260810 04:15:26.982350 31380 raft_consensus.cc:2781] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:15:26.982405 31380 raft_consensus.cc:482] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:15:26.982434 31380 raft_consensus.cc:3037] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:26.982455 31171 raft_consensus.cc:2454] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01f4ab5c3a104d909dd670f657e30e57 in term 0.
I20260810 04:15:26.983156 31380 raft_consensus.cc:504] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.983274 31380 leader_election.cc:288] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [CANDIDATE]: Term 1 election: Requested vote from peers 0d8116394a5e4d4f9c4cfed82b799926 (127.10.249.129:37773), c7de93bb105a4923b4bd6edb57e2f816 (127.10.249.130:42349)
I20260810 04:15:26.983422 31036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d79031c62c6f48df83735e91df7e9bf4" candidate_uuid: "01f4ab5c3a104d909dd670f657e30e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d8116394a5e4d4f9c4cfed82b799926"
I20260810 04:15:26.983429 31171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d79031c62c6f48df83735e91df7e9bf4" candidate_uuid: "01f4ab5c3a104d909dd670f657e30e57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7de93bb105a4923b4bd6edb57e2f816"
I20260810 04:15:26.983501 31171 raft_consensus.cc:3037] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:26.983513 31036 raft_consensus.cc:3037] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:26.984177 31036 raft_consensus.cc:2454] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01f4ab5c3a104d909dd670f657e30e57 in term 1.
I20260810 04:15:26.984217 31171 raft_consensus.cc:2454] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01f4ab5c3a104d909dd670f657e30e57 in term 1.
I20260810 04:15:26.984370 31242 leader_election.cc:302] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01f4ab5c3a104d909dd670f657e30e57, 0d8116394a5e4d4f9c4cfed82b799926; no voters:
I20260810 04:15:26.984452 31380 raft_consensus.cc:2781] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:26.984591 31380 raft_consensus.cc:686] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 1 LEADER]: Becoming Leader. State: Replica: 01f4ab5c3a104d909dd670f657e30e57, State: Running, Role: LEADER
I20260810 04:15:26.984681 31380 consensus_queue.cc:237] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } }
I20260810 04:15:26.985425 30886 catalog_manager.cc:5495] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01f4ab5c3a104d909dd670f657e30e57 (127.10.249.131). New cstate: current_term: 1 leader_uuid: "01f4ab5c3a104d909dd670f657e30e57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01f4ab5c3a104d909dd670f657e30e57" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 41747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 } health_report { overall_health: UNKNOWN } } }
I20260810 04:15:27.004848 31374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:27.003143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59760 (local address 127.10.249.131:41747)
0810 04:15:27.003203 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:27.003204 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:27.003211 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:15:27.003234 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:27.003234 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:27.003266 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:27.003323 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:27.003402 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:27.003773 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:27.004344 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:27.004489 (+ 145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:27.004530 (+ 41us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:27.004637 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:27.004708 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:27.004766 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:27.004786 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 04:15:27.004793 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:15:27.006563 31171 raft_consensus.cc:1261] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 1 FOLLOWER]: Refusing update from remote peer 01f4ab5c3a104d909dd670f657e30e57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:27.006574 31036 raft_consensus.cc:1261] T d79031c62c6f48df83735e91df7e9bf4 P 0d8116394a5e4d4f9c4cfed82b799926 [term 1 FOLLOWER]: Refusing update from remote peer 01f4ab5c3a104d909dd670f657e30e57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:27.006888 31386 consensus_queue.cc:1035] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7de93bb105a4923b4bd6edb57e2f816" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:27.007012 31380 consensus_queue.cc:1035] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d8116394a5e4d4f9c4cfed82b799926" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 37773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:27.009153 31389 mvcc.cc:205] Tried to move back new op lower bound from 7316829499416408064 to 7316829499329888256. Current Snapshot: MvccSnapshot[applied={T|T < 7316829499416408064}]
I20260810 04:15:27.009507 31390 mvcc.cc:205] Tried to move back new op lower bound from 7316829499416408064 to 7316829499329888256. Current Snapshot: MvccSnapshot[applied={T|T < 7316829499416408064}]
I20260810 04:15:27.010411 31391 mvcc.cc:205] Tried to move back new op lower bound from 7316829499416408064 to 7316829499329888256. Current Snapshot: MvccSnapshot[applied={T|T < 7316829499416408064}]
I20260810 04:15:27.012390 30886 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:27.012461 30886 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:27.013144 30886 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 18172ee01642410d921c2c0aef4c0429: Sending DeleteTablet for 3 replicas of tablet d79031c62c6f48df83735e91df7e9bf4
I20260810 04:15:27.013484 31150 tablet_service.cc:1514] Processing DeleteTablet for tablet d79031c62c6f48df83735e91df7e9bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:27 UTC) from {username='slave'} at 127.0.0.1:43482
I20260810 04:15:27.013506 31016 tablet_service.cc:1514] Processing DeleteTablet for tablet d79031c62c6f48df83735e91df7e9bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:27 UTC) from {username='slave'} at 127.0.0.1:35346
I20260810 04:15:27.013659 31292 tablet_service.cc:1514] Processing DeleteTablet for tablet d79031c62c6f48df83735e91df7e9bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:27 UTC) from {username='slave'} at 127.0.0.1:59750
I20260810 04:15:27.013751 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 30949
I20260810 04:15:27.014637 31399 tablet_replica.cc:330] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: stopping tablet replica
I20260810 04:15:27.014736 31399 raft_consensus.cc:2229] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:15:27.014822 31399 raft_consensus.cc:2258] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:27.015201 31399 ts_tablet_manager.cc:1905] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:27.017130 31399 ts_tablet_manager.cc:1918] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:27.017201 31399 log.cc:1196] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/d79031c62c6f48df83735e91df7e9bf4
I20260810 04:15:27.017421 31399 ts_tablet_manager.cc:1939] T d79031c62c6f48df83735e91df7e9bf4 P c7de93bb105a4923b4bd6edb57e2f816: Deleting consensus metadata
I20260810 04:15:27.017830 30871 catalog_manager.cc:4841] TS c7de93bb105a4923b4bd6edb57e2f816 (127.10.249.130:42349): tablet d79031c62c6f48df83735e91df7e9bf4 (table test-table [id=b61f0bbc2cd4465e9ab643a99dfb7194]) successfully deleted
W20260810 04:15:27.020900 30871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:37773 (error 108)
I20260810 04:15:27.021131 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 31086
I20260810 04:15:27.021732 31401 tablet_replica.cc:330] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57: stopping tablet replica
I20260810 04:15:27.021847 31401 raft_consensus.cc:2229] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:15:27.021929 31401 raft_consensus.cc:2258] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:27.021973 31371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:27.021266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:37773 (local address 127.0.0.1:35356)
0810 04:15:27.021890 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:27.021936 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:37773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":601}
W20260810 04:15:27.022181 30871 catalog_manager.cc:4584] TS 0d8116394a5e4d4f9c4cfed82b799926 (127.10.249.129:37773): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d79031c62c6f48df83735e91df7e9bf4: Network error: Client connection negotiation failed: client connection to 127.10.249.129:37773: connect: Connection refused (error 111)
I20260810 04:15:27.026146 31401 ts_tablet_manager.cc:1905] T d79031c62c6f48df83735e91df7e9bf4 P 01f4ab5c3a104d909dd670f657e30e57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:27.027290 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 31226
I20260810 04:15:27.032888 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 30854
I20260810 04:15:27.033003 31371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:27.032883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:41747 (local address 127.0.0.1:59766)
0810 04:15:27.032942 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:27.032968 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.131:41747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
2026-08-10T04:15:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (771 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:27 dist-test-slave-0kls krb5kdc[31406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:27 dist-test-slave-0kls krb5kdc[31406](info): set up 2 sockets
Aug 10 04:15:27 dist-test-slave-0kls krb5kdc[31406](info): commencing operation
krb5kdc: starting...
W20260810 04:15:28.007892 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.955s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:28.120230 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:41381
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:41381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:28.195880 31419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:28.196048 31419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:28.196069 31419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:28.197032 31419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:28.197060 31419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:28.197072 31419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:28.197083 31419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:28.197093 31419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:28.198396 31419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:41381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:41381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:28.198557 31419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:28.198699 31419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:28.203284 31424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:28.203292 31425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:28.203296 31427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:28.203576 31419 server_base.cc:1034] running on GCE node
I20260810 04:15:28.203797 31419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:28.204025 31419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:28.205165 31419 hybrid_clock.cc:648] HybridClock initialized: now 1786335328205147 us; error 35 us; skew 500 ppm
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:28.212482 31419 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:28.212950 31419 webserver.cc:460] Webserver started at http://127.10.249.190:41351/ using document root <none> and password file <none>
I20260810 04:15:28.213195 31419 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:28.213258 31419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:28.213397 31419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:28.214411 31419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "190c7acfe6e149a3b1fa7c199cb54590"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "6c7c8177351c3e7132cf704a3c3f727a"
server_key_iv: "4ebd0058d80e919346029870217dc35d"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.214743 31419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "190c7acfe6e149a3b1fa7c199cb54590"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "6c7c8177351c3e7132cf704a3c3f727a"
server_key_iv: "4ebd0058d80e919346029870217dc35d"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.216022 31419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:28.216715 31435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.216876 31419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:28.216979 31419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "190c7acfe6e149a3b1fa7c199cb54590"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "6c7c8177351c3e7132cf704a3c3f727a"
server_key_iv: "4ebd0058d80e919346029870217dc35d"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.217046 31419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:28.236163 31419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:28.237730 31419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:28.237914 31419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:28.241824 31490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:41381 every 8 connection(s)
I20260810 04:15:28.241776 31419 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:41381
I20260810 04:15:28.242213 31419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:28.243081 31491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:28.244539 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 31419
I20260810 04:15:28.244659 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:28.244843 11238 external_mini_cluster.cc:1428] Setting key 4656ab5d1f36145b18e55a6016155850
I20260810 04:15:28.245646 31491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590: Bootstrap starting.
I20260810 04:15:28.246269 31491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:28.246594 31491 log.cc:824] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:28.247313 31491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590: No bootstrap required, opened a new log
I20260810 04:15:28.249547 31491 raft_consensus.cc:348] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "190c7acfe6e149a3b1fa7c199cb54590" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41381 } }
I20260810 04:15:28.249722 31491 raft_consensus.cc:374] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:28.249811 31491 raft_consensus.cc:729] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 190c7acfe6e149a3b1fa7c199cb54590, State: Initialized, Role: FOLLOWER
I20260810 04:15:28.249964 31491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "190c7acfe6e149a3b1fa7c199cb54590" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41381 } }
I20260810 04:15:28.250049 31491 raft_consensus.cc:388] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:28.250089 31491 raft_consensus.cc:482] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:28.250136 31491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:28.250864 31491 raft_consensus.cc:504] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "190c7acfe6e149a3b1fa7c199cb54590" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41381 } }
I20260810 04:15:28.251010 31491 leader_election.cc:302] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 190c7acfe6e149a3b1fa7c199cb54590; no voters:
I20260810 04:15:28.251170 31491 leader_election.cc:288] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:28.251219 31496 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:28.251358 31496 raft_consensus.cc:686] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [term 1 LEADER]: Becoming Leader. State: Replica: 190c7acfe6e149a3b1fa7c199cb54590, State: Running, Role: LEADER
I20260810 04:15:28.251415 31491 sys_catalog.cc:564] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:28.251456 31496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "190c7acfe6e149a3b1fa7c199cb54590" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41381 } }
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:28.251799 31496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 190c7acfe6e149a3b1fa7c199cb54590. Latest consensus state: current_term: 1 leader_uuid: "190c7acfe6e149a3b1fa7c199cb54590" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "190c7acfe6e149a3b1fa7c199cb54590" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41381 } } }
I20260810 04:15:28.251889 31496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:28.251809 31497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "190c7acfe6e149a3b1fa7c199cb54590" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "190c7acfe6e149a3b1fa7c199cb54590" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 41381 } } }
I20260810 04:15:28.252074 31497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:28.252336 31504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:28.253080 31504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:28.254693 31504 catalog_manager.cc:1347] Generated new cluster ID: 5f4c6361517a4db1b578e7040a96e51c
I20260810 04:15:28.254752 31504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:28.255723 31494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.245329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40844 (local address 127.10.249.190:41381)
0810 04:15:28.245493 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:28.245500 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:28.245524 (+ 24us) server_negotiation.cc:407] Connection header received
0810 04:15:28.245978 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:28.245985 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:28.246037 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:28.246140 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:28.246901 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.247823 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.248838 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.249216 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.249291 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.252260 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:28.252265 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:28.252265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:28.252277 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:28.254085 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.254435 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.254438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.254439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.254530 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.254737 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.254739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.254739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.254998 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:28.255116 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:28.255423 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 04:15:28.255543 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260810 04:15:28.263103 31504 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:28.263593 31504 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:28.267927 31504 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590: Generated new TSK 0
I20260810 04:15:28.268085 31504 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.249.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
Entry for principal kudu/127.10.249.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab.
I20260810 04:15:28.292532 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41381
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:28.368449 31518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:28.368611 31518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:28.368629 31518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:28.369678 31518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:28.369712 31518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:28.369737 31518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:15:28.371004 31518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.129.keytab
--principal=kudu/127.10.249.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:28.371189 31518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:28.371338 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:28.375597 31523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:28.375613 31524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:28.375610 31526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:28.375859 31518 server_base.cc:1034] running on GCE node
I20260810 04:15:28.376057 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:28.376315 31518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:28.377470 31518 hybrid_clock.cc:648] HybridClock initialized: now 1786335328377456 us; error 25 us; skew 500 ppm
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:28.379881 31518 init.cc:377] Logged in from keytab as kudu/127.10.249.129@KRBTEST.COM (short username kudu)
I20260810 04:15:28.380249 31518 webserver.cc:460] Webserver started at http://127.10.249.129:41815/ using document root <none> and password file <none>
I20260810 04:15:28.380427 31518 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:28.380467 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:28.380553 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:28.381469 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "d9e698ff56f54ffba908f2f5bd8c3e32"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "84de33e77038407668647df14e502bb7"
server_key_iv: "903251762346eb9fa3133593e28e0601"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.381748 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "d9e698ff56f54ffba908f2f5bd8c3e32"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "84de33e77038407668647df14e502bb7"
server_key_iv: "903251762346eb9fa3133593e28e0601"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.382942 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:15:28.383598 31533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.383764 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:15:28.383850 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "d9e698ff56f54ffba908f2f5bd8c3e32"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "84de33e77038407668647df14e502bb7"
server_key_iv: "903251762346eb9fa3133593e28e0601"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.383903 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:28.396322 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:28.398389 31518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:28.398492 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:28.398640 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:28.398950 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:28.398983 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.399026 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:28.399052 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.404738 31518 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:35501
I20260810 04:15:28.404825 31652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:35501 every 8 connection(s)
I20260810 04:15:28.405146 31518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:15:28.406901 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 31518
I20260810 04:15:28.407032 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:15:28.407197 11238 external_mini_cluster.cc:1428] Setting key aef419cd5a126a5c424e57db647a019d
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.129@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:28.414063 31494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.405828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:33435 (local address 127.10.249.190:41381)
0810 04:15:28.405867 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:28.405869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:28.406060 (+ 191us) server_negotiation.cc:407] Connection header received
0810 04:15:28.406533 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:28.406534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:28.406548 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:28.406594 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:28.407553 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.408044 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.408988 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.409215 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.409302 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.411338 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:28.411340 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:28.411340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:28.411347 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:28.412656 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.413032 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.413033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.413033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.413110 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.413393 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.413394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.413394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.413512 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:28.413591 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:28.413883 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 04:15:28.413971 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:15:28.414250 31655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.405816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41381 (local address 127.10.249.129:33435)
0810 04:15:28.405957 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:28.405988 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:28.406430 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:28.406662 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:28.406666 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:28.407268 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:28.407464 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.407469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.408134 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.408135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.408896 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.408898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.409314 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.409315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.409444 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.409979 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:28.409986 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:28.411238 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:28.412737 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:28.412743 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:28.412745 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:28.412963 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:28.413184 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:28.413185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:28.413185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:28.413325 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:28.413582 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:28.413589 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:28.413733 (+ 144us) client_negotiation.cc:769] Sending connection context
0810 04:15:28.413859 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 04:15:28.414016 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260810 04:15:28.414767 31653 heartbeater.cc:347] Connected to a master server at 127.10.249.190:41381
I20260810 04:15:28.414851 31653 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:28.415025 31653 heartbeater.cc:511] Master 127.10.249.190:41381 requested a full tablet report, sending...
I20260810 04:15:28.415562 31452 ts_manager.cc:194] Registered new tserver with Master: d9e698ff56f54ffba908f2f5bd8c3e32 (127.10.249.129:35501)
WARNING: no policy specified for kudu/127.10.249.130@KRBTEST.COM; defaulting to no policy
I20260810 04:15:28.416319 31452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.129@KRBTEST.COM'} at 127.10.249.129:33435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
Entry for principal kudu/127.10.249.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab.
I20260810 04:15:28.432389 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41381
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:28.509017 31658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:28.509207 31658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:28.509229 31658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:28.510433 31658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:28.510473 31658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:28.510499 31658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:15:28.511857 31658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.130.keytab
--principal=kudu/127.10.249.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:28.512017 31658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:28.512176 31658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:28.516956 31663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:28.517048 31658 server_base.cc:1034] running on GCE node
W20260810 04:15:28.516963 31664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:28.517215 31666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:28.517426 31658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:28.517678 31658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:28.518850 31658 hybrid_clock.cc:648] HybridClock initialized: now 1786335328518831 us; error 33 us; skew 500 ppm
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:28.521440 31658 init.cc:377] Logged in from keytab as kudu/127.10.249.130@KRBTEST.COM (short username kudu)
I20260810 04:15:28.521989 31658 webserver.cc:460] Webserver started at http://127.10.249.130:41071/ using document root <none> and password file <none>
I20260810 04:15:28.522224 31658 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:28.522269 31658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:28.522413 31658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:28.523424 31658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "27206fa8d88840f5b695af7184dccd8a"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "8710eeabceeabddd4de743b40cea73c5"
server_key_iv: "1bb2de615a97a593cdc575a09bc05191"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.523797 31658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "27206fa8d88840f5b695af7184dccd8a"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "8710eeabceeabddd4de743b40cea73c5"
server_key_iv: "1bb2de615a97a593cdc575a09bc05191"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.525031 31658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:28.525702 31674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.525882 31658 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:28.525987 31658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "27206fa8d88840f5b695af7184dccd8a"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "8710eeabceeabddd4de743b40cea73c5"
server_key_iv: "1bb2de615a97a593cdc575a09bc05191"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.526058 31658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:28.533776 31658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:28.535879 31658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:28.536019 31658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:28.536217 31658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:28.536481 31658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:28.536530 31658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.536557 31658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:28.536583 31658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.542559 31658 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:41413
I20260810 04:15:28.542595 31790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:41413 every 8 connection(s)
I20260810 04:15:28.542904 31658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:15:28.546882 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 31658
I20260810 04:15:28.547019 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:15:28.547192 11238 external_mini_cluster.cc:1428] Setting key ad3ac481e4c097f767cd699e26c059ef
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.130@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:28.552037 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.543578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41381 (local address 127.10.249.130:54441)
0810 04:15:28.543730 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:28.543767 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:28.544187 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:28.544379 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:28.544381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:28.545082 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:28.545251 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.545256 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.545944 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.545945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.546740 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.546743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.547134 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.547135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.547274 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.547720 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:28.547727 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:28.549136 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:28.550843 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:28.550848 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:28.550850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:28.551041 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:28.551232 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:28.551232 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:28.551233 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:28.551300 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:28.551573 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:28.551578 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:28.551737 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 04:15:28.551810 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:15:28.551908 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":89,"threads_started":1}
I20260810 04:15:28.552265 31494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.543619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:54441 (local address 127.10.249.190:41381)
0810 04:15:28.543666 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:28.543668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:28.543863 (+ 195us) server_negotiation.cc:407] Connection header received
0810 04:15:28.544277 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:28.544278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:28.544288 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:28.544337 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:28.545337 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.545867 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.546846 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.547067 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.547124 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.549235 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:28.549236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:28.549236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:28.549244 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:28.550773 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.551110 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.551111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.551111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.551171 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.551353 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.551354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.551354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.551498 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:28.551582 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:28.551858 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 04:15:28.551964 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:15:28.552685 31791 heartbeater.cc:347] Connected to a master server at 127.10.249.190:41381
I20260810 04:15:28.552775 31791 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:28.552927 31791 heartbeater.cc:511] Master 127.10.249.190:41381 requested a full tablet report, sending...
I20260810 04:15:28.553340 31452 ts_manager.cc:194] Registered new tserver with Master: 27206fa8d88840f5b695af7184dccd8a (127.10.249.130:41413)
I20260810 04:15:28.553880 31452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.130@KRBTEST.COM'} at 127.10.249.130:54441
WARNING: no policy specified for kudu/127.10.249.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
Entry for principal kudu/127.10.249.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab.
I20260810 04:15:28.572733 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41381
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:28.647298 31796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:28.647492 31796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:28.647526 31796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:28.648490 31796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:28.648550 31796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:28.648586 31796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:15:28.650082 31796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.131.keytab
--principal=kudu/127.10.249.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:41381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:28.650347 31796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:28.650542 31796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:28.655273 31802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:28.655300 31804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:28.655341 31796 server_base.cc:1034] running on GCE node
W20260810 04:15:28.655308 31801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:28.655589 31796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:28.655861 31796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:28.657012 31796 hybrid_clock.cc:648] HybridClock initialized: now 1786335328657008 us; error 33 us; skew 500 ppm
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:28.659334 31796 init.cc:377] Logged in from keytab as kudu/127.10.249.131@KRBTEST.COM (short username kudu)
I20260810 04:15:28.659795 31796 webserver.cc:460] Webserver started at http://127.10.249.131:43337/ using document root <none> and password file <none>
I20260810 04:15:28.660019 31796 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:28.660085 31796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:28.660234 31796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:28.661183 31796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "6f495737e5df4eb193835d9c7d175abc"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "af28ce1e09cce82cbd6b86c0dc3cea2e"
server_key_iv: "29cb42941c8db7839eb31c1b41449c41"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.661506 31796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "6f495737e5df4eb193835d9c7d175abc"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "af28ce1e09cce82cbd6b86c0dc3cea2e"
server_key_iv: "29cb42941c8db7839eb31c1b41449c41"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.662822 31796 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:28.663455 31811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.663610 31796 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:28.663705 31796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "6f495737e5df4eb193835d9c7d175abc"
format_stamp: "Formatted at 2026-08-10 04:15:28 on dist-test-slave-0kls"
server_key: "af28ce1e09cce82cbd6b86c0dc3cea2e"
server_key_iv: "29cb42941c8db7839eb31c1b41449c41"
server_key_version: "encryptionkey@0"
I20260810 04:15:28.663779 31796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:28.682590 31796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:28.684098 31796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:28.684250 31796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:28.684443 31796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:28.684716 31796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:28.684767 31796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.684798 31796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:28.684823 31796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:28.690717 31796 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:43185
I20260810 04:15:28.690775 31932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:43185 every 8 connection(s)
I20260810 04:15:28.691043 31796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:15:28 dist-test-slave-0kls krb5kdc[31406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335328, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.131@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:28.697084 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 31796
I20260810 04:15:28.697219 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:15:28.697387 11238 external_mini_cluster.cc:1428] Setting key 8502e43423e6c2069741aceaf616c004
I20260810 04:15:28.699028 31494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.691618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:50797 (local address 127.10.249.190:41381)
0810 04:15:28.691673 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:28.691674 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:28.691876 (+ 202us) server_negotiation.cc:407] Connection header received
0810 04:15:28.692223 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:28.692224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:28.692234 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:28.692285 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:28.693093 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.693551 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.694358 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.694523 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.694578 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.696244 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:28.696246 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:28.696246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:28.696253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:28.697603 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.698154 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.698156 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.698156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.698222 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.698504 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.698505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.698505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.698627 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:28.698686 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:28.698914 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 04:15:28.698969 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:15:28.699187 31935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.691591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:41381 (local address 127.10.249.131:50797)
0810 04:15:28.691744 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:28.691776 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:28.692144 (+ 368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:28.692327 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:28.692330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:28.692830 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:28.692983 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.692987 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.693622 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.693623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.694285 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.694287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.694592 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.694593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.694680 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.695009 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:28.695016 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:28.696154 (+ 1138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:28.697704 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:28.697713 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:28.697715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:28.698087 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:28.698293 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:28.698293 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:28.698294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:28.698428 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:28.698697 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:28.698701 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:28.698802 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 04:15:28.698898 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 04:15:28.699005 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260810 04:15:28.699594 31933 heartbeater.cc:347] Connected to a master server at 127.10.249.190:41381
I20260810 04:15:28.699700 31933 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:28.699875 31933 heartbeater.cc:511] Master 127.10.249.190:41381 requested a full tablet report, sending...
I20260810 04:15:28.700249 31452 ts_manager.cc:194] Registered new tserver with Master: 6f495737e5df4eb193835d9c7d175abc (127.10.249.131:43185)
I20260810 04:15:28.700598 31452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.249.131@KRBTEST.COM'} at 127.10.249.131:50797
I20260810 04:15:28.709285 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:15:28.715797 31494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.710613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40858 (local address 127.10.249.190:41381)
0810 04:15:28.710686 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:28.710688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:28.710771 (+ 83us) server_negotiation.cc:407] Connection header received
0810 04:15:28.710838 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:28.710839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:28.710848 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:28.710891 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:28.711394 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.711807 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.712457 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.712631 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.712702 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.713726 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:28.713727 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:28.713728 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:28.713734 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:28.714760 (+ 1026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.715061 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.715062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.715062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.715110 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:28.715312 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:28.715313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:28.715314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:28.715440 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:28.715532 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:28.715627 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 04:15:28.715712 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:15:28.716985 31452 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:15:28.718441 31452 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:15:28.724275 31941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.720518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:43185 (local address 127.0.0.1:59128)
0810 04:15:28.720676 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:28.720709 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:28.720770 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:28.721254 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:28.721255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:28.721257 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:28.721305 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.721307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.722537 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.722538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.723404 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.723406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.723988 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.723989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.724067 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.724079 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 04:15:28.724162 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 04:15:28.724212 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":46,"threads_started":1}
I20260810 04:15:28.724287 31943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.720585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59128 (local address 127.10.249.131:43185)
0810 04:15:28.721088 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:28.721092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:28.721100 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:15:28.721130 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:28.721132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:28.721151 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:28.721238 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:28.721387 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.722428 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.723466 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.723896 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.723978 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.724028 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:28.724182 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 04:15:28.724215 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":100,"threads_started":1}
I20260810 04:15:28.724555 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.720518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:35501 (local address 127.0.0.1:34618)
0810 04:15:28.720857 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:28.720867 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:28.720976 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:28.721162 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:28.721165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:28.721167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:28.721225 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.721226 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.722337 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.722339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.723418 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.723421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.724314 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.724315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.724391 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.724396 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:15:28.724454 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 04:15:28.724488 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":20,"thread_start_us":51,"threads_started":1}
I20260810 04:15:28.724725 31945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.720718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:41413 (local address 127.0.0.1:35858)
0810 04:15:28.720937 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:28.720958 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:28.721001 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:28.721491 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:28.721492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:28.721493 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:28.721532 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.721533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.722650 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.722651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.723643 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:28.723645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.724527 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.724528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:28.724579 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.724583 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:15:28.724631 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 04:15:28.724669 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":74,"threads_started":1}
I20260810 04:15:28.724843 31944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.720693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34618 (local address 127.10.249.129:35501)
0810 04:15:28.720840 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:28.720844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:28.720977 (+ 133us) server_negotiation.cc:407] Connection header received
0810 04:15:28.721049 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:28.721052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:28.721066 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:28.721317 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:28.721405 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.722238 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.723510 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.724169 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.724235 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.724281 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:28.724721 (+ 440us) server_negotiation.cc:299] Negotiation successful
0810 04:15:28.724768 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260810 04:15:28.724931 31946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:28.720933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35858 (local address 127.10.249.130:41413)
0810 04:15:28.721350 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:28.721354 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:28.721362 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:15:28.721404 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:28.721406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:28.721422 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:28.721493 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:28.721587 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.722561 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.723725 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:28.724378 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:28.724455 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:28.724498 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:28.724812 (+ 314us) server_negotiation.cc:299] Negotiation successful
0810 04:15:28.724854 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":88,"threads_started":1}
I20260810 04:15:28.725181 31861 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff5873611aa46ea95221c6c343223f7 (DEFAULT_TABLE table=test-table [id=c9f2fb5d04f24825a8d7a739ee5a36a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:28.725514 31861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff5873611aa46ea95221c6c343223f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:28.725414 31583 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff5873611aa46ea95221c6c343223f7 (DEFAULT_TABLE table=test-table [id=c9f2fb5d04f24825a8d7a739ee5a36a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:28.725766 31583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff5873611aa46ea95221c6c343223f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:28.726342 31722 tablet_service.cc:1467] Processing CreateTablet for tablet 9ff5873611aa46ea95221c6c343223f7 (DEFAULT_TABLE table=test-table [id=c9f2fb5d04f24825a8d7a739ee5a36a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:28.726637 31722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ff5873611aa46ea95221c6c343223f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:28.727943 31947 tablet_bootstrap.cc:492] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Bootstrap starting.
I20260810 04:15:28.728639 31947 tablet_bootstrap.cc:654] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:28.728950 31948 tablet_bootstrap.cc:492] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32: Bootstrap starting.
I20260810 04:15:28.729195 31947 log.cc:824] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:28.729610 31948 tablet_bootstrap.cc:654] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:28.729774 31950 tablet_bootstrap.cc:492] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Bootstrap starting.
I20260810 04:15:28.730075 31947 tablet_bootstrap.cc:492] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: No bootstrap required, opened a new log
I20260810 04:15:28.730176 31947 ts_tablet_manager.cc:1397] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:15:28.730274 31948 log.cc:824] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:28.730473 31950 tablet_bootstrap.cc:654] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:28.731011 31950 log.cc:824] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:28.731050 31948 tablet_bootstrap.cc:492] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32: No bootstrap required, opened a new log
I20260810 04:15:28.731099 31948 ts_tablet_manager.cc:1397] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:15:28.731750 31950 tablet_bootstrap.cc:492] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: No bootstrap required, opened a new log
I20260810 04:15:28.731822 31950 ts_tablet_manager.cc:1397] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:15:28.731788 31947 raft_consensus.cc:348] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:28.731981 31947 raft_consensus.cc:374] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:28.732018 31947 raft_consensus.cc:729] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f495737e5df4eb193835d9c7d175abc, State: Initialized, Role: FOLLOWER
I20260810 04:15:28.732138 31947 consensus_queue.cc:260] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:28.732424 31947 ts_tablet_manager.cc:1428] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:15:28.732434 31933 heartbeater.cc:503] Master 127.10.249.190:41381 was elected leader, sending a full tablet report...
I20260810 04:15:28.733583 31950 raft_consensus.cc:348] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:28.733748 31950 raft_consensus.cc:374] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:28.733798 31948 raft_consensus.cc:348] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:28.733909 31950 raft_consensus.cc:729] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27206fa8d88840f5b695af7184dccd8a, State: Initialized, Role: FOLLOWER
I20260810 04:15:28.733947 31948 raft_consensus.cc:374] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:28.733984 31948 raft_consensus.cc:729] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e698ff56f54ffba908f2f5bd8c3e32, State: Initialized, Role: FOLLOWER
I20260810 04:15:28.734021 31950 consensus_queue.cc:260] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:28.734071 31948 consensus_queue.cc:260] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:28.734310 31948 ts_tablet_manager.cc:1428] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:15:28.734309 31950 ts_tablet_manager.cc:1428] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260810 04:15:28.734320 31791 heartbeater.cc:503] Master 127.10.249.190:41381 was elected leader, sending a full tablet report...
I20260810 04:15:28.734391 31653 heartbeater.cc:503] Master 127.10.249.190:41381 was elected leader, sending a full tablet report...
W20260810 04:15:28.793458 31792 tablet.cc:2369] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:15:28.906037 31654 tablet.cc:2369] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:15:28.941632 31934 tablet.cc:2369] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:15:29.005523 31953 raft_consensus.cc:482] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:29.005640 31953 raft_consensus.cc:504] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:29.006062 31953 leader_election.cc:288] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e698ff56f54ffba908f2f5bd8c3e32 (127.10.249.129:35501), 27206fa8d88840f5b695af7184dccd8a (127.10.249.130:41413)
I20260810 04:15:29.008880 31935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.006253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:35501 (local address 127.10.249.131:34059)
0810 04:15:29.006314 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.006325 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.006377 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.006515 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.006516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.006517 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:29.006607 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.006609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.007311 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.007312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.008081 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.008083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.008619 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.008620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.008705 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.008708 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.008757 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.008788 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":25}
I20260810 04:15:29.008894 31944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.006302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:34059 (local address 127.10.249.129:35501)
0810 04:15:29.006377 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.006380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.006391 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:15:29.006428 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.006429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.006439 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.006514 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:29.006701 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.007234 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.008172 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.008544 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.008599 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.008606 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.008779 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.008827 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:15:29.008950 31946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.006378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:56903 (local address 127.10.249.130:41413)
0810 04:15:29.006424 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.006426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.006551 (+ 125us) server_negotiation.cc:407] Connection header received
0810 04:15:29.006608 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.006610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.006620 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.006682 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:29.006831 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.007289 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.008214 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.008600 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.008681 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.008689 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.008843 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.008877 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:15:29.009014 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.006288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:41413 (local address 127.10.249.131:56903)
0810 04:15:29.006483 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.006493 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.006547 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.006692 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.006693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.006695 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:29.006765 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.006767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.007375 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.007376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.008105 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.008106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.008688 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.008689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.008765 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.008770 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.008828 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.008866 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":107,"threads_started":1}
I20260810 04:15:29.009276 31604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff5873611aa46ea95221c6c343223f7" candidate_uuid: "6f495737e5df4eb193835d9c7d175abc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" is_pre_election: true
I20260810 04:15:29.009336 31742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff5873611aa46ea95221c6c343223f7" candidate_uuid: "6f495737e5df4eb193835d9c7d175abc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27206fa8d88840f5b695af7184dccd8a" is_pre_election: true
I20260810 04:15:29.009436 31604 raft_consensus.cc:2454] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f495737e5df4eb193835d9c7d175abc in term 0.
I20260810 04:15:29.009478 31742 raft_consensus.cc:2454] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f495737e5df4eb193835d9c7d175abc in term 0.
I20260810 04:15:29.009709 31815 leader_election.cc:302] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f495737e5df4eb193835d9c7d175abc, d9e698ff56f54ffba908f2f5bd8c3e32; no voters:
I20260810 04:15:29.009941 31953 raft_consensus.cc:2781] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:15:29.009994 31953 raft_consensus.cc:482] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:15:29.010036 31953 raft_consensus.cc:3037] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:29.010814 31953 raft_consensus.cc:504] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:29.010950 31953 leader_election.cc:288] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [CANDIDATE]: Term 1 election: Requested vote from peers d9e698ff56f54ffba908f2f5bd8c3e32 (127.10.249.129:35501), 27206fa8d88840f5b695af7184dccd8a (127.10.249.130:41413)
I20260810 04:15:29.011155 31604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff5873611aa46ea95221c6c343223f7" candidate_uuid: "6f495737e5df4eb193835d9c7d175abc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32"
I20260810 04:15:29.011179 31742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ff5873611aa46ea95221c6c343223f7" candidate_uuid: "6f495737e5df4eb193835d9c7d175abc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27206fa8d88840f5b695af7184dccd8a"
I20260810 04:15:29.011243 31604 raft_consensus.cc:3037] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:29.011241 31742 raft_consensus.cc:3037] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:29.012053 31604 raft_consensus.cc:2454] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f495737e5df4eb193835d9c7d175abc in term 1.
I20260810 04:15:29.012187 31742 raft_consensus.cc:2454] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f495737e5df4eb193835d9c7d175abc in term 1.
I20260810 04:15:29.012238 31815 leader_election.cc:302] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f495737e5df4eb193835d9c7d175abc, d9e698ff56f54ffba908f2f5bd8c3e32; no voters:
I20260810 04:15:29.012328 31953 raft_consensus.cc:2781] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:29.012512 31953 raft_consensus.cc:686] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 1 LEADER]: Becoming Leader. State: Replica: 6f495737e5df4eb193835d9c7d175abc, State: Running, Role: LEADER
I20260810 04:15:29.012645 31953 consensus_queue.cc:237] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } }
I20260810 04:15:29.013592 31451 catalog_manager.cc:5495] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f495737e5df4eb193835d9c7d175abc (127.10.249.131). New cstate: current_term: 1 leader_uuid: "6f495737e5df4eb193835d9c7d175abc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f495737e5df4eb193835d9c7d175abc" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 43185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 } health_report { overall_health: UNKNOWN } } }
I20260810 04:15:29.074811 31943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.072729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59138 (local address 127.10.249.131:43185)
0810 04:15:29.072786 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.072787 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.072794 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:15:29.072830 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.072831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.072848 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.072907 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:29.073011 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.073492 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.074193 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.074365 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.074413 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.074541 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:29.074642 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:29.074714 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.074740 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.074755 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:15:29.076637 31742 raft_consensus.cc:1261] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 1 FOLLOWER]: Refusing update from remote peer 6f495737e5df4eb193835d9c7d175abc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:29.076653 31604 raft_consensus.cc:1261] T 9ff5873611aa46ea95221c6c343223f7 P d9e698ff56f54ffba908f2f5bd8c3e32 [term 1 FOLLOWER]: Refusing update from remote peer 6f495737e5df4eb193835d9c7d175abc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:29.077025 31957 consensus_queue.cc:1035] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e698ff56f54ffba908f2f5bd8c3e32" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 35501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:29.077167 31953 consensus_queue.cc:1035] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [LEADER]: Connected to new peer: Peer: permanent_uuid: "27206fa8d88840f5b695af7184dccd8a" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:29.080080 31962 mvcc.cc:205] Tried to move back new op lower bound from 7316829507895181312 to 7316829507636428800. Current Snapshot: MvccSnapshot[applied={T|T < 7316829507895181312 or (T in {7316829507895181312})}]
I20260810 04:15:29.080572 31961 mvcc.cc:205] Tried to move back new op lower bound from 7316829507895181312 to 7316829507636428800. Current Snapshot: MvccSnapshot[applied={T|T < 7316829507895181312}]
I20260810 04:15:29.081871 31451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:29.081956 31451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:29.082618 31451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 190c7acfe6e149a3b1fa7c199cb54590: Sending DeleteTablet for 3 replicas of tablet 9ff5873611aa46ea95221c6c343223f7
I20260810 04:15:29.082923 31583 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ff5873611aa46ea95221c6c343223f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:29 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:34618
I20260810 04:15:29.082947 31722 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ff5873611aa46ea95221c6c343223f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:29 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:35858
I20260810 04:15:29.082947 31861 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ff5873611aa46ea95221c6c343223f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:29 UTC) from {username='kudu', principal='kudu/127.10.249.190@KRBTEST.COM'} at 127.0.0.1:59128
I20260810 04:15:29.083143 31972 tablet_replica.cc:330] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: stopping tablet replica
I20260810 04:15:29.083235 31972 raft_consensus.cc:2229] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:15:29.083328 31972 raft_consensus.cc:2258] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:29.083483 31971 tablet_replica.cc:330] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: stopping tablet replica
I20260810 04:15:29.083500 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 31518
I20260810 04:15:29.083570 31971 raft_consensus.cc:2229] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:15:29.083664 31971 raft_consensus.cc:2258] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:29.083904 31972 ts_tablet_manager.cc:1905] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:29.085656 31972 ts_tablet_manager.cc:1918] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:29.085770 31972 log.cc:1196] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/9ff5873611aa46ea95221c6c343223f7
I20260810 04:15:29.085762 31971 ts_tablet_manager.cc:1905] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:29.086171 31972 ts_tablet_manager.cc:1939] T 9ff5873611aa46ea95221c6c343223f7 P 6f495737e5df4eb193835d9c7d175abc: Deleting consensus metadata
I20260810 04:15:29.087100 31437 catalog_manager.cc:4841] TS 6f495737e5df4eb193835d9c7d175abc (127.10.249.131:43185): tablet 9ff5873611aa46ea95221c6c343223f7 (table test-table [id=c9f2fb5d04f24825a8d7a739ee5a36a3]) successfully deleted
I20260810 04:15:29.087744 31971 ts_tablet_manager.cc:1918] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:29.087814 31971 log.cc:1196] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/9ff5873611aa46ea95221c6c343223f7
I20260810 04:15:29.088119 31971 ts_tablet_manager.cc:1939] T 9ff5873611aa46ea95221c6c343223f7 P 27206fa8d88840f5b695af7184dccd8a: Deleting consensus metadata
I20260810 04:15:29.088629 31437 catalog_manager.cc:4841] TS 27206fa8d88840f5b695af7184dccd8a (127.10.249.130:41413): tablet 9ff5873611aa46ea95221c6c343223f7 (table test-table [id=c9f2fb5d04f24825a8d7a739ee5a36a3]) successfully deleted
W20260810 04:15:29.091918 31439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:35501 (error 108)
I20260810 04:15:29.092208 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 31658
I20260810 04:15:29.094199 31941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.092280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:35501 (local address 127.0.0.1:34632)
0810 04:15:29.094088 (+ 1808us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.094140 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:35501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1783}
W20260810 04:15:29.096047 31439 catalog_manager.cc:4584] TS d9e698ff56f54ffba908f2f5bd8c3e32 (127.10.249.129:35501): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9ff5873611aa46ea95221c6c343223f7: Network error: Client connection negotiation failed: client connection to 127.10.249.129:35501: connect: Connection refused (error 111)
I20260810 04:15:29.101886 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 31796
I20260810 04:15:29.106500 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 31419
2026-08-10T04:15:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2074 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T04:15:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:29Z Disabled control of system clock
I20260810 04:15:29.135347 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43725
--webserver_interface=127.10.249.190
--webserver_port=0
--builtin_ntp_servers=127.10.249.148:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:43725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:29.214380 31978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:29.214563 31978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:29.214581 31978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:29.215638 31978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:29.215678 31978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:29.215692 31978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:29.215704 31978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:29.215716 31978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:29.216979 31978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:43725
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:29.217149 31978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:29.217356 31978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:29.222069 31986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:29.222043 31984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:29.222236 31978 server_base.cc:1034] running on GCE node
W20260810 04:15:29.222028 31983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:29.222581 31978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:29.222899 31978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:29.224069 31978 hybrid_clock.cc:648] HybridClock initialized: now 1786335329224047 us; error 34 us; skew 500 ppm
I20260810 04:15:29.225370 31978 webserver.cc:460] Webserver started at http://127.10.249.190:42175/ using document root <none> and password file <none>
I20260810 04:15:29.225615 31978 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:29.225704 31978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:29.225895 31978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:29.226934 31978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "4d6a22a93e444699a7fe3a5b0cc0a677"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "051958e3862eb0929bf6a4d19e1f27a2"
server_key_iv: "3ab8441fd5828a2a81526ad28fa7aac3"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.227332 31978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "4d6a22a93e444699a7fe3a5b0cc0a677"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "051958e3862eb0929bf6a4d19e1f27a2"
server_key_iv: "3ab8441fd5828a2a81526ad28fa7aac3"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.228574 31978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:29.229310 31993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.229482 31978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:29.229592 31978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "4d6a22a93e444699a7fe3a5b0cc0a677"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "051958e3862eb0929bf6a4d19e1f27a2"
server_key_iv: "3ab8441fd5828a2a81526ad28fa7aac3"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.229667 31978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:29.236188 31978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:29.236450 31978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:29.236591 31978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:29.240511 31978 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:43725
I20260810 04:15:29.240540 32047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:43725 every 8 connection(s)
I20260810 04:15:29.240852 31978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:29.241750 32049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:29.243875 32049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677: Bootstrap starting.
I20260810 04:15:29.244370 32049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:29.244601 32049 log.cc:824] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:29.245170 32049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677: No bootstrap required, opened a new log
I20260810 04:15:29.246714 32049 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6a22a93e444699a7fe3a5b0cc0a677" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43725 } }
I20260810 04:15:29.246835 32049 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:29.246856 32049 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6a22a93e444699a7fe3a5b0cc0a677, State: Initialized, Role: FOLLOWER
I20260810 04:15:29.246978 32049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6a22a93e444699a7fe3a5b0cc0a677" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43725 } }
I20260810 04:15:29.247054 32049 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:29.247076 32049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:29.247103 32049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:29.247522 32049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6a22a93e444699a7fe3a5b0cc0a677" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43725 } }
I20260810 04:15:29.247599 32049 leader_election.cc:302] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d6a22a93e444699a7fe3a5b0cc0a677; no voters:
I20260810 04:15:29.247722 32049 leader_election.cc:288] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:29.247803 32052 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:29.247988 32052 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [term 1 LEADER]: Becoming Leader. State: Replica: 4d6a22a93e444699a7fe3a5b0cc0a677, State: Running, Role: LEADER
I20260810 04:15:29.248006 32049 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:29.248086 32052 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6a22a93e444699a7fe3a5b0cc0a677" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43725 } }
I20260810 04:15:29.248574 32053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d6a22a93e444699a7fe3a5b0cc0a677" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6a22a93e444699a7fe3a5b0cc0a677" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43725 } } }
I20260810 04:15:29.248665 32053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:29.248642 32054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d6a22a93e444699a7fe3a5b0cc0a677. Latest consensus state: current_term: 1 leader_uuid: "4d6a22a93e444699a7fe3a5b0cc0a677" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6a22a93e444699a7fe3a5b0cc0a677" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43725 } } }
I20260810 04:15:29.248970 32054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:29.249208 32061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:29.249421 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 31978
I20260810 04:15:29.249533 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:29.249740 11238 external_mini_cluster.cc:1428] Setting key 2f3372c9ac049ab8b1dc8efbb4350d88
I20260810 04:15:29.249806 32061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:29.251605 32061 catalog_manager.cc:1347] Generated new cluster ID: 3b7e942de4214e91a481739c1039d301
I20260810 04:15:29.251662 32061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:29.256956 32073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.250156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58488 (local address 127.10.249.190:43725)
0810 04:15:29.250673 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.250681 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.250703 (+ 22us) server_negotiation.cc:407] Connection header received
0810 04:15:29.250813 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.250819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.250902 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.251037 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:29.251268 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.252582 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.253616 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.255274 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.255698 (+ 424us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.256139 (+ 441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:29.256143 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:29.256143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:29.256338 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:29.256377 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:29.256389 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:29.256670 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.256700 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.256770 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":67,"threads_started":1}
I20260810 04:15:29.268671 32061 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:29.269351 32061 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:29.278757 32061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677: Generated new TSK 0
I20260810 04:15:29.278916 32061 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:29.284623 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.129:0
--local_ip_for_outbound_sockets=127.10.249.129
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43725
--builtin_ntp_servers=127.10.249.148:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:29.363051 32075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:29.363241 32075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:29.363272 32075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:29.364225 32075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:29.364279 32075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:29.364315 32075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.129
I20260810 04:15:29.365623 32075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.249.129
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.129
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:29.365928 32075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:29.366227 32075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:29.371024 32082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:29.371064 32080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:29.371044 32084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:29.371214 32075 server_base.cc:1034] running on GCE node
I20260810 04:15:29.371387 32075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:29.371600 32075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:29.372764 32075 hybrid_clock.cc:648] HybridClock initialized: now 1786335329372756 us; error 41 us; skew 500 ppm
I20260810 04:15:29.374081 32075 webserver.cc:460] Webserver started at http://127.10.249.129:44819/ using document root <none> and password file <none>
I20260810 04:15:29.374321 32075 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:29.374365 32075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:29.374501 32075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:29.375432 32075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/data/instance:
uuid: "6de9fc83d47d417983c692fefddbde31"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "cc2b497ff38e3d08cd53a4f9ad5d16f2"
server_key_iv: "9a908f1a95bb2a5915f405e543d0ce42"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.375774 32075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance:
uuid: "6de9fc83d47d417983c692fefddbde31"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "cc2b497ff38e3d08cd53a4f9ad5d16f2"
server_key_iv: "9a908f1a95bb2a5915f405e543d0ce42"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.376997 32075 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:15:29.377650 32090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.377848 32075 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:15:29.377936 32075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/wal
uuid: "6de9fc83d47d417983c692fefddbde31"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "cc2b497ff38e3d08cd53a4f9ad5d16f2"
server_key_iv: "9a908f1a95bb2a5915f405e543d0ce42"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.378008 32075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:29.387660 32075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:29.387909 32075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:29.388073 32075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:29.388271 32075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:29.388563 32075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:29.388616 32075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.388662 32075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:29.388690 32075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.394249 32075 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.129:38447
I20260810 04:15:29.394286 32208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.129:38447 every 8 connection(s)
I20260810 04:15:29.394582 32075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/data/info.pb
I20260810 04:15:29.399849 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 32075
I20260810 04:15:29.399945 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-0/wal/instance
I20260810 04:15:29.400082 11238 external_mini_cluster.cc:1428] Setting key e6016355d9a41722e7798ed387773cd8
I20260810 04:15:29.400970 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.130:0
--local_ip_for_outbound_sockets=127.10.249.130
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43725
--builtin_ntp_servers=127.10.249.148:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 04:15:29.403061 32073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.395284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.129:47993 (local address 127.10.249.190:43725)
0810 04:15:29.395348 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.395350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.395558 (+ 208us) server_negotiation.cc:407] Connection header received
0810 04:15:29.395906 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.395907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.395917 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.395964 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:29.396469 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.396911 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.397728 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.397994 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.398043 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.402770 (+ 4727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:29.402772 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:29.402772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:29.402779 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:29.402798 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:29.402802 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:29.402863 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.402957 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.402986 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:15:29.403311 32211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.395267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43725 (local address 127.10.249.129:47993)
0810 04:15:29.395441 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.395473 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.395837 (+ 364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.396005 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.396008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.396015 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:29.396408 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.396411 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.396984 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.396984 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.397658 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.397659 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.398077 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.398078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.398193 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.402612 (+ 4419us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:29.402613 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:29.402639 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:29.402660 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:29.402865 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:29.402872 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:29.402875 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.402960 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.403057 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":83,"threads_started":1}
I20260810 04:15:29.403815 32209 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43725
I20260810 04:15:29.403923 32209 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:29.404111 32209 heartbeater.cc:511] Master 127.10.249.190:43725 requested a full tablet report, sending...
I20260810 04:15:29.404639 32011 ts_manager.cc:194] Registered new tserver with Master: 6de9fc83d47d417983c692fefddbde31 (127.10.249.129:38447)
I20260810 04:15:29.405658 32011 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.129:47993
W20260810 04:15:29.477806 32212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:29.477967 32212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:29.477985 32212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:29.478932 32212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:29.478966 32212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:29.478991 32212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.130
I20260810 04:15:29.480341 32212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.249.130
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.130
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:29.480507 32212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:29.480722 32212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:29.485198 32217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:29.485206 32218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:29.485234 32220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:29.485409 32212 server_base.cc:1034] running on GCE node
I20260810 04:15:29.485688 32212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:29.485913 32212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:29.487046 32212 hybrid_clock.cc:648] HybridClock initialized: now 1786335329487027 us; error 32 us; skew 500 ppm
I20260810 04:15:29.488284 32212 webserver.cc:460] Webserver started at http://127.10.249.130:42651/ using document root <none> and password file <none>
I20260810 04:15:29.488500 32212 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:29.488543 32212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:29.488689 32212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:29.489850 32212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/data/instance:
uuid: "a025ba1b74904f1f83ec880a377e97c2"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "bcdeca34bca3b286947f7a4b42db1c5a"
server_key_iv: "15fa24eff82abdeb6df6085d91e72c69"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.490239 32212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance:
uuid: "a025ba1b74904f1f83ec880a377e97c2"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "bcdeca34bca3b286947f7a4b42db1c5a"
server_key_iv: "15fa24eff82abdeb6df6085d91e72c69"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.491482 32212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:29.492069 32226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.492267 32212 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:29.492365 32212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/wal
uuid: "a025ba1b74904f1f83ec880a377e97c2"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "bcdeca34bca3b286947f7a4b42db1c5a"
server_key_iv: "15fa24eff82abdeb6df6085d91e72c69"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.492437 32212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:29.521449 32212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:29.521742 32212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:29.521906 32212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:29.522123 32212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:29.522459 32212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:29.522512 32212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.522553 32212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:29.522581 32212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.527901 32212 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.130:33545
I20260810 04:15:29.527972 32345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.130:33545 every 8 connection(s)
I20260810 04:15:29.528308 32212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/data/info.pb
I20260810 04:15:29.533201 32073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.529104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.130:47577 (local address 127.10.249.190:43725)
0810 04:15:29.529171 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.529175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.529413 (+ 238us) server_negotiation.cc:407] Connection header received
0810 04:15:29.529871 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.529872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.529882 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.529953 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:29.530553 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.531025 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.531966 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.532149 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.532215 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.532957 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:29.532958 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:29.532958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:29.532962 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:29.532972 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:29.532975 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:29.533054 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.533098 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.533130 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:15:29.533373 32350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.529093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43725 (local address 127.10.249.130:47577)
0810 04:15:29.529286 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.529324 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.529772 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.530001 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.530003 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.530011 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:29.530480 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.530484 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.531100 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.531101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.531844 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.531846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.532232 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.532233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.532366 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.532835 (+ 469us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:29.532835 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:29.532860 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:29.532891 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:29.533054 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:29.533056 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:29.533058 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.533098 (+ 40us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.533192 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":106,"threads_started":1}
I20260810 04:15:29.533876 32348 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43725
I20260810 04:15:29.533975 32348 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:29.534133 32348 heartbeater.cc:511] Master 127.10.249.190:43725 requested a full tablet report, sending...
I20260810 04:15:29.534483 32011 ts_manager.cc:194] Registered new tserver with Master: a025ba1b74904f1f83ec880a377e97c2 (127.10.249.130:33545)
I20260810 04:15:29.534787 32011 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.130:47577
I20260810 04:15:29.537264 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 32212
I20260810 04:15:29.537372 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/wal/instance
I20260810 04:15:29.537585 11238 external_mini_cluster.cc:1428] Setting key 96f4e01e968998acbe55506168f13670
I20260810 04:15:29.538900 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.249.131:0
--local_ip_for_outbound_sockets=127.10.249.131
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43725
--builtin_ntp_servers=127.10.249.148:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:15:29.626622 32351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:29.626781 32351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:29.626799 32351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:29.627753 32351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:29.627789 32351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:29.627830 32351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.249.131
I20260810 04:15:29.629010 32351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.249.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.249.131
--webserver_port=0
--tserver_master_addrs=127.10.249.190:43725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.249.131
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:29.629241 32351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:29.629525 32351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:15:29.634356 32351 server_base.cc:1034] running on GCE node
W20260810 04:15:29.634310 32356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:29.634310 32360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:29.634361 32357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:29.634697 32351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:29.634933 32351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:29.636085 32351 hybrid_clock.cc:648] HybridClock initialized: now 1786335329636078 us; error 36 us; skew 500 ppm
I20260810 04:15:29.637213 32351 webserver.cc:460] Webserver started at http://127.10.249.131:46023/ using document root <none> and password file <none>
I20260810 04:15:29.637430 32351 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:29.637494 32351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:29.637630 32351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:29.638597 32351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/data/instance:
uuid: "ff3c645859eb4a3e81911b5ce14dba8b"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "072ebc79b2b5e2ab94ac86052d61613d"
server_key_iv: "ae0a600f2f5d5fff1c59bc65eddfb064"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.638955 32351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance:
uuid: "ff3c645859eb4a3e81911b5ce14dba8b"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "072ebc79b2b5e2ab94ac86052d61613d"
server_key_iv: "ae0a600f2f5d5fff1c59bc65eddfb064"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.640249 32351 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:29.640900 32366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.641075 32351 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:29.641170 32351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/wal
uuid: "ff3c645859eb4a3e81911b5ce14dba8b"
format_stamp: "Formatted at 2026-08-10 04:15:29 on dist-test-slave-0kls"
server_key: "072ebc79b2b5e2ab94ac86052d61613d"
server_key_iv: "ae0a600f2f5d5fff1c59bc65eddfb064"
server_key_version: "encryptionkey@0"
I20260810 04:15:29.641259 32351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:29.661662 32351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:29.661942 32351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:29.662086 32351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:29.662283 32351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:15:29.662597 32351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:15:29.662652 32351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.662693 32351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:15:29.662719 32351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:29.668077 32351 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.131:37963
I20260810 04:15:29.668111 32483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.131:37963 every 8 connection(s)
I20260810 04:15:29.668386 32351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/data/info.pb
I20260810 04:15:29.673128 32073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.669090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:38539 (local address 127.10.249.190:43725)
0810 04:15:29.669162 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.669164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.669388 (+ 224us) server_negotiation.cc:407] Connection header received
0810 04:15:29.669907 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.669908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.669922 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.669987 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:29.670621 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.671083 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.671961 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.672172 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.672238 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.672869 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:29.672870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:29.672871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:29.672875 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:29.672890 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:29.672894 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:29.672939 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.673027 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.673059 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 04:15:29.673301 32488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.669085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:43725 (local address 127.10.249.131:38539)
0810 04:15:29.669274 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.669305 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.669749 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.670050 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.670054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.670088 (+ 34us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:29.670533 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.670537 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.671186 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.671187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.671864 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.671867 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.672255 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.672256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.672365 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.672744 (+ 379us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:15:29.672744 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:29.672768 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:15:29.672787 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:29.672938 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:29.672943 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:29.672945 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.673021 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.673109 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260810 04:15:29.673697 32485 heartbeater.cc:347] Connected to a master server at 127.10.249.190:43725
I20260810 04:15:29.673764 32485 heartbeater.cc:464] Registering TS with master...
I20260810 04:15:29.673943 32485 heartbeater.cc:511] Master 127.10.249.190:43725 requested a full tablet report, sending...
I20260810 04:15:29.674252 32011 ts_manager.cc:194] Registered new tserver with Master: ff3c645859eb4a3e81911b5ce14dba8b (127.10.249.131:37963)
I20260810 04:15:29.674584 32011 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.249.131:38539
I20260810 04:15:29.675585 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 32351
I20260810 04:15:29.675676 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/wal/instance
I20260810 04:15:29.675817 11238 external_mini_cluster.cc:1428] Setting key 2d049653989fc881be86ac2f074b4b17
I20260810 04:15:29.676540 11238 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:15:29.680258 32073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.677705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58502 (local address 127.10.249.190:43725)
0810 04:15:29.677773 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.677775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.677847 (+ 72us) server_negotiation.cc:407] Connection header received
0810 04:15:29.677898 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.677899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.677907 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.677948 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:29.678128 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.678528 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.679297 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.679470 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.679521 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.680043 (+ 522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:29.680044 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:29.680044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:29.680047 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:29.680058 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:29.680062 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:29.680104 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.680144 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.680164 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:15:29.681694 32011 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58502:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:15:29.683255 32011 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:15:29.689203 32495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.685270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.131:37963 (local address 127.0.0.1:48688)
0810 04:15:29.685658 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.685668 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.685726 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.685944 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.685945 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.685946 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:29.685989 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.685990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.687122 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.687123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.687978 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.687980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.688906 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.688907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.688987 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.689000 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.689083 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.689131 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":69,"thread_start_us":100,"threads_started":1}
I20260810 04:15:29.689229 32499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.685463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48688 (local address 127.10.249.131:37963)
0810 04:15:29.685605 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.685610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.685720 (+ 110us) server_negotiation.cc:407] Connection header received
0810 04:15:29.685804 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.685806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.685821 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.685893 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:29.686078 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.687041 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.688072 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.688795 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.688886 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.688960 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.689109 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.689144 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260810 04:15:29.689536 32498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.685424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38447 (local address 127.0.0.1:43040)
0810 04:15:29.685844 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.685853 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.685896 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.686240 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.686240 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.686242 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:29.686278 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.686280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.687189 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.687190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.688522 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.688524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.689342 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.689343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.689400 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.689404 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.689440 (+ 36us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.689479 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":70,"threads_started":1}
I20260810 04:15:29.689597 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.685520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43040 (local address 127.10.249.129:38447)
0810 04:15:29.685682 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.685686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.685949 (+ 263us) server_negotiation.cc:407] Connection header received
0810 04:15:29.685990 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.685993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.686007 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.686154 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:29.686397 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.687099 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.688620 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.689275 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.689345 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.689431 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.689466 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.689497 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260810 04:15:29.689806 32496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.685209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:33545 (local address 127.0.0.1:46768)
0810 04:15:29.685421 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.685459 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.685513 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.685742 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.685745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.685747 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:29.685823 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.685824 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.687049 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.687051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.688336 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.688338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.689581 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.689582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.689649 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.689653 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.689684 (+ 31us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.689720 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":63,"thread_start_us":69,"threads_started":1}
I20260810 04:15:29.689992 32415 tablet_service.cc:1467] Processing CreateTablet for tablet a73e8dd5c32b428e9c7b44c30288a3b2 (DEFAULT_TABLE table=test-table [id=24059cd788964a66a4574326a887388c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:29.690338 32415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73e8dd5c32b428e9c7b44c30288a3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:29.690507 32497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.685300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46768 (local address 127.10.249.130:33545)
0810 04:15:29.685594 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.685598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.685606 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:15:29.685643 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.685645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.685660 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.685732 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:29.685903 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.686938 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.688432 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.689167 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.690269 (+ 1102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.690362 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.690388 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.690428 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":87,"threads_started":1}
I20260810 04:15:29.691035 32276 tablet_service.cc:1467] Processing CreateTablet for tablet a73e8dd5c32b428e9c7b44c30288a3b2 (DEFAULT_TABLE table=test-table [id=24059cd788964a66a4574326a887388c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:29.691349 32276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73e8dd5c32b428e9c7b44c30288a3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:29.692849 32501 tablet_bootstrap.cc:492] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: Bootstrap starting.
I20260810 04:15:29.693473 32501 tablet_bootstrap.cc:654] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:29.693367 32140 tablet_service.cc:1467] Processing CreateTablet for tablet a73e8dd5c32b428e9c7b44c30288a3b2 (DEFAULT_TABLE table=test-table [id=24059cd788964a66a4574326a887388c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:15:29.693698 32140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73e8dd5c32b428e9c7b44c30288a3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:29.693771 32501 log.cc:824] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:29.694098 32502 tablet_bootstrap.cc:492] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: Bootstrap starting.
I20260810 04:15:29.694474 32501 tablet_bootstrap.cc:492] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: No bootstrap required, opened a new log
I20260810 04:15:29.694555 32501 ts_tablet_manager.cc:1397] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:15:29.694710 32502 tablet_bootstrap.cc:654] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:29.694999 32502 log.cc:824] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:29.695864 32502 tablet_bootstrap.cc:492] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: No bootstrap required, opened a new log
I20260810 04:15:29.695940 32502 ts_tablet_manager.cc:1397] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:15:29.696815 32505 tablet_bootstrap.cc:492] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31: Bootstrap starting.
I20260810 04:15:29.697140 32501 raft_consensus.cc:348] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.697299 32501 raft_consensus.cc:374] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:29.697335 32501 raft_consensus.cc:729] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3c645859eb4a3e81911b5ce14dba8b, State: Initialized, Role: FOLLOWER
I20260810 04:15:29.697412 32505 tablet_bootstrap.cc:654] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:29.697485 32501 consensus_queue.cc:260] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.697732 32501 ts_tablet_manager.cc:1428] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:15:29.697726 32505 log.cc:824] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:29.697774 32485 heartbeater.cc:503] Master 127.10.249.190:43725 was elected leader, sending a full tablet report...
I20260810 04:15:29.698593 32505 tablet_bootstrap.cc:492] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31: No bootstrap required, opened a new log
I20260810 04:15:29.698673 32505 ts_tablet_manager.cc:1397] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:15:29.698576 32502 raft_consensus.cc:348] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.698725 32502 raft_consensus.cc:374] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:29.698769 32502 raft_consensus.cc:729] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a025ba1b74904f1f83ec880a377e97c2, State: Initialized, Role: FOLLOWER
I20260810 04:15:29.698889 32502 consensus_queue.cc:260] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.699162 32502 ts_tablet_manager.cc:1428] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260810 04:15:29.699198 32348 heartbeater.cc:503] Master 127.10.249.190:43725 was elected leader, sending a full tablet report...
I20260810 04:15:29.700793 32505 raft_consensus.cc:348] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.700906 32505 raft_consensus.cc:374] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:29.700928 32505 raft_consensus.cc:729] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de9fc83d47d417983c692fefddbde31, State: Initialized, Role: FOLLOWER
I20260810 04:15:29.700997 32505 consensus_queue.cc:260] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.701167 32505 ts_tablet_manager.cc:1428] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:15:29.701241 32209 heartbeater.cc:503] Master 127.10.249.190:43725 was elected leader, sending a full tablet report...
I20260810 04:15:29.743759 32506 raft_consensus.cc:482] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:15:29.743902 32506 raft_consensus.cc:504] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.744284 32506 leader_election.cc:288] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a025ba1b74904f1f83ec880a377e97c2 (127.10.249.130:33545), 6de9fc83d47d417983c692fefddbde31 (127.10.249.129:38447)
I20260810 04:15:29.746938 32497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.744497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:44509 (local address 127.10.249.130:33545)
0810 04:15:29.744560 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.744562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.744572 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:15:29.744599 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.744600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.744612 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.744666 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:29.744867 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.745369 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.746279 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.746607 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.746699 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.746707 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.746843 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.746878 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:15:29.746937 32488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.744442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.130:33545 (local address 127.10.249.131:44509)
0810 04:15:29.744486 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.744498 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.744546 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.744723 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.744724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.744726 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:29.744790 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.744792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.745449 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.745450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.746196 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.746198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.746700 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.746701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.746766 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.746769 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.746839 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.746877 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 04:15:29.747004 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.744619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.249.131:41255 (local address 127.10.249.129:38447)
0810 04:15:29.744657 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.744659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.744800 (+ 141us) server_negotiation.cc:407] Connection header received
0810 04:15:29.744857 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.744858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.744875 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.744914 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:15:29.745078 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.745484 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.746340 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.746671 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.746748 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.746755 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.746909 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.746942 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:15:29.747095 32510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.744555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38447 (local address 127.10.249.131:41255)
0810 04:15:29.744714 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.744744 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:29.744805 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:29.744929 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:29.744929 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:29.744931 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:15:29.744993 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.744995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.745567 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.745569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.746251 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:29.746253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.746750 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.746751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:29.746835 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.746844 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 04:15:29.746904 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:15:29.746936 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
I20260810 04:15:29.747305 32297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73e8dd5c32b428e9c7b44c30288a3b2" candidate_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a025ba1b74904f1f83ec880a377e97c2" is_pre_election: true
I20260810 04:15:29.747347 32160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73e8dd5c32b428e9c7b44c30288a3b2" candidate_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de9fc83d47d417983c692fefddbde31" is_pre_election: true
I20260810 04:15:29.747430 32297 raft_consensus.cc:2454] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff3c645859eb4a3e81911b5ce14dba8b in term 0.
I20260810 04:15:29.747510 32160 raft_consensus.cc:2454] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff3c645859eb4a3e81911b5ce14dba8b in term 0.
I20260810 04:15:29.747643 32369 leader_election.cc:302] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a025ba1b74904f1f83ec880a377e97c2, ff3c645859eb4a3e81911b5ce14dba8b; no voters:
I20260810 04:15:29.747776 32506 raft_consensus.cc:2781] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:15:29.747852 32506 raft_consensus.cc:482] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:15:29.747886 32506 raft_consensus.cc:3037] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:29.748610 32506 raft_consensus.cc:504] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.748736 32506 leader_election.cc:288] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [CANDIDATE]: Term 1 election: Requested vote from peers a025ba1b74904f1f83ec880a377e97c2 (127.10.249.130:33545), 6de9fc83d47d417983c692fefddbde31 (127.10.249.129:38447)
I20260810 04:15:29.748976 32160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73e8dd5c32b428e9c7b44c30288a3b2" candidate_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de9fc83d47d417983c692fefddbde31"
I20260810 04:15:29.749001 32297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73e8dd5c32b428e9c7b44c30288a3b2" candidate_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a025ba1b74904f1f83ec880a377e97c2"
I20260810 04:15:29.749069 32297 raft_consensus.cc:3037] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:29.749063 32160 raft_consensus.cc:3037] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:29.750006 32160 raft_consensus.cc:2454] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3c645859eb4a3e81911b5ce14dba8b in term 1.
I20260810 04:15:29.750006 32297 raft_consensus.cc:2454] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3c645859eb4a3e81911b5ce14dba8b in term 1.
I20260810 04:15:29.750258 32369 leader_election.cc:302] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6de9fc83d47d417983c692fefddbde31, ff3c645859eb4a3e81911b5ce14dba8b; no voters:
I20260810 04:15:29.750370 32506 raft_consensus.cc:2781] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:29.750561 32506 raft_consensus.cc:686] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 1 LEADER]: Becoming Leader. State: Replica: ff3c645859eb4a3e81911b5ce14dba8b, State: Running, Role: LEADER
I20260810 04:15:29.750674 32506 consensus_queue.cc:237] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } }
I20260810 04:15:29.751523 32009 catalog_manager.cc:5495] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b reported cstate change: term changed from 0 to 1, leader changed from <none> to ff3c645859eb4a3e81911b5ce14dba8b (127.10.249.131). New cstate: current_term: 1 leader_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3c645859eb4a3e81911b5ce14dba8b" member_type: VOTER last_known_addr { host: "127.10.249.131" port: 37963 } health_report { overall_health: HEALTHY } } }
I20260810 04:15:29.763084 32499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.760833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.10.249.131:37963)
0810 04:15:29.760886 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:29.760888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:29.760897 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:15:29.760922 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:29.760922 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:29.760936 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:29.760996 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:29.761130 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.761565 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.762325 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:29.762501 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:29.762551 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:29.762822 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:29.762904 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:29.762963 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:29.763011 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 04:15:29.763025 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:15:29.764735 32297 raft_consensus.cc:1261] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 1 FOLLOWER]: Refusing update from remote peer ff3c645859eb4a3e81911b5ce14dba8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:29.764735 32160 raft_consensus.cc:1261] T a73e8dd5c32b428e9c7b44c30288a3b2 P 6de9fc83d47d417983c692fefddbde31 [term 1 FOLLOWER]: Refusing update from remote peer ff3c645859eb4a3e81911b5ce14dba8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:29.765043 32506 consensus_queue.cc:1035] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a025ba1b74904f1f83ec880a377e97c2" member_type: VOTER last_known_addr { host: "127.10.249.130" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:29.765190 32511 consensus_queue.cc:1035] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de9fc83d47d417983c692fefddbde31" member_type: VOTER last_known_addr { host: "127.10.249.129" port: 38447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:29.767619 32516 mvcc.cc:205] Tried to move back new op lower bound from 7316829510713925632 to 7316829510659657728. Current Snapshot: MvccSnapshot[applied={T|T < 7316829510713925632}]
I20260810 04:15:29.769688 32009 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58502:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:29.769763 32009 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58502:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:15:29.770541 32009 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d6a22a93e444699a7fe3a5b0cc0a677: Sending DeleteTablet for 3 replicas of tablet a73e8dd5c32b428e9c7b44c30288a3b2
I20260810 04:15:29.770864 32415 tablet_service.cc:1514] Processing DeleteTablet for tablet a73e8dd5c32b428e9c7b44c30288a3b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:29 UTC) from {username='slave'} at 127.0.0.1:48688
I20260810 04:15:29.770929 32276 tablet_service.cc:1514] Processing DeleteTablet for tablet a73e8dd5c32b428e9c7b44c30288a3b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:29 UTC) from {username='slave'} at 127.0.0.1:46768
I20260810 04:15:29.770949 32140 tablet_service.cc:1514] Processing DeleteTablet for tablet a73e8dd5c32b428e9c7b44c30288a3b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:15:29 UTC) from {username='slave'} at 127.0.0.1:43040
I20260810 04:15:29.771198 32525 tablet_replica.cc:330] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: stopping tablet replica
I20260810 04:15:29.771317 32525 raft_consensus.cc:2229] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:15:29.771384 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 32075
I20260810 04:15:29.772506 32524 tablet_replica.cc:330] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: stopping tablet replica
I20260810 04:15:29.772619 32524 raft_consensus.cc:2229] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:15:29.772742 32524 raft_consensus.cc:2258] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:29.771476 32525 raft_consensus.cc:2258] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:15:29.773262 32524 ts_tablet_manager.cc:1905] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:29.773708 32525 ts_tablet_manager.cc:1905] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:15:29.775193 32525 ts_tablet_manager.cc:1918] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:29.775298 32525 log.cc:1196] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-1/wal/wals/a73e8dd5c32b428e9c7b44c30288a3b2
I20260810 04:15:29.775357 32524 ts_tablet_manager.cc:1918] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:15:29.775430 32524 log.cc:1196] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: Deleting WAL directory at /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786335069075394-11238-0/minicluster-data/ts-2/wal/wals/a73e8dd5c32b428e9c7b44c30288a3b2
I20260810 04:15:29.775607 32525 ts_tablet_manager.cc:1939] T a73e8dd5c32b428e9c7b44c30288a3b2 P a025ba1b74904f1f83ec880a377e97c2: Deleting consensus metadata
I20260810 04:15:29.775664 32524 ts_tablet_manager.cc:1939] T a73e8dd5c32b428e9c7b44c30288a3b2 P ff3c645859eb4a3e81911b5ce14dba8b: Deleting consensus metadata
I20260810 04:15:29.776062 31996 catalog_manager.cc:4841] TS a025ba1b74904f1f83ec880a377e97c2 (127.10.249.130:33545): tablet a73e8dd5c32b428e9c7b44c30288a3b2 (table test-table [id=24059cd788964a66a4574326a887388c]) successfully deleted
I20260810 04:15:29.776067 31994 catalog_manager.cc:4841] TS ff3c645859eb4a3e81911b5ce14dba8b (127.10.249.131:37963): tablet a73e8dd5c32b428e9c7b44c30288a3b2 (table test-table [id=24059cd788964a66a4574326a887388c]) successfully deleted
W20260810 04:15:29.783185 31996 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.249.129:38447 (error 108)
I20260810 04:15:29.783448 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 32212
I20260810 04:15:29.783643 32496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:29.783522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.129:38447 (local address 127.0.0.1:43046)
0810 04:15:29.783575 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:29.783609 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.129:38447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 04:15:29.784857 31996 catalog_manager.cc:4584] TS 6de9fc83d47d417983c692fefddbde31 (127.10.249.129:38447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a73e8dd5c32b428e9c7b44c30288a3b2: Network error: Client connection negotiation failed: client connection to 127.10.249.129:38447: connect: Connection refused (error 111)
I20260810 04:15:29.788545 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 32351
I20260810 04:15:29.793648 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 31978
2026-08-10T04:15:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (685 ms)
[----------] 6 tests from EncryptionPolicyTest (8016 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:29 dist-test-slave-0kls krb5kdc[32530](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:29 dist-test-slave-0kls krb5kdc[32530](info): set up 2 sockets
Aug 10 04:15:29 dist-test-slave-0kls krb5kdc[32530](info): commencing operation
krb5kdc: starting...
W20260810 04:15:30.782982 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.970s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:30 dist-test-slave-0kls krb5kdc[32530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:30.896894 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42933
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:30.973019 32543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:30.973273 32543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:30.973311 32543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:30.974466 32543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:30.974529 32543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:30.974563 32543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:30.974586 32543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:30.974623 32543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:30.975988 32543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42933
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:30.976263 32543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:30.976478 32543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:30.980993 32548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:30.981000 32551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:30.981000 32549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:30.981078 32543 server_base.cc:1034] running on GCE node
I20260810 04:15:30.981441 32543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:30.981717 32543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:30.982849 32543 hybrid_clock.cc:648] HybridClock initialized: now 1786335330982843 us; error 27 us; skew 500 ppm
Aug 10 04:15:30 dist-test-slave-0kls krb5kdc[32530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335330, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:30.985046 32543 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:30.985423 32543 webserver.cc:460] Webserver started at http://127.0.0.1:35761/ using document root <none> and password file <none>
I20260810 04:15:30.985658 32543 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:30.985720 32543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:30.985877 32543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:30.986925 32543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55"
format_stamp: "Formatted at 2026-08-10 04:15:30 on dist-test-slave-0kls"
server_key: "ea42b423a3575021f5293fb31d1d0bd2"
server_key_iv: "14ad63014f89977eab1a6b88fc230bcd"
server_key_version: "encryptionkey@0"
I20260810 04:15:30.987280 32543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55"
format_stamp: "Formatted at 2026-08-10 04:15:30 on dist-test-slave-0kls"
server_key: "ea42b423a3575021f5293fb31d1d0bd2"
server_key_iv: "14ad63014f89977eab1a6b88fc230bcd"
server_key_version: "encryptionkey@0"
I20260810 04:15:30.988533 32543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:30.989199 32558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:30.989367 32543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:30.989470 32543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55"
format_stamp: "Formatted at 2026-08-10 04:15:30 on dist-test-slave-0kls"
server_key: "ea42b423a3575021f5293fb31d1d0bd2"
server_key_iv: "14ad63014f89977eab1a6b88fc230bcd"
server_key_version: "encryptionkey@0"
I20260810 04:15:30.989552 32543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:31.004209 32543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:31.006134 32543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:31.006302 32543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:31.010290 32543 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42933
I20260810 04:15:31.010324 32613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42933 every 8 connection(s)
I20260810 04:15:31.010615 32543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:31.011379 32614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:31.013707 32614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55: Bootstrap starting.
I20260810 04:15:31.014400 32614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:31.014676 32614 log.cc:824] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:31.015292 32614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55: No bootstrap required, opened a new log
I20260810 04:15:31.016664 32614 raft_consensus.cc:348] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42933 } }
I20260810 04:15:31.016783 32614 raft_consensus.cc:374] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:31.016826 32614 raft_consensus.cc:729] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 427bb7dcc0f2483cbe39acbd1a3d8a55, State: Initialized, Role: FOLLOWER
I20260810 04:15:31.016953 32614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42933 } }
I20260810 04:15:31.017010 32614 raft_consensus.cc:388] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:31.017030 32614 raft_consensus.cc:482] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:31.017079 32614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:31.017514 32614 raft_consensus.cc:504] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42933 } }
I20260810 04:15:31.017619 32614 leader_election.cc:302] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 427bb7dcc0f2483cbe39acbd1a3d8a55; no voters:
I20260810 04:15:31.017809 32614 leader_election.cc:288] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:31.017848 32617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:31.017997 32617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [term 1 LEADER]: Becoming Leader. State: Replica: 427bb7dcc0f2483cbe39acbd1a3d8a55, State: Running, Role: LEADER
I20260810 04:15:31.018060 32614 sys_catalog.cc:564] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:31.018069 32617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42933 } }
I20260810 04:15:31.018482 32618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42933 } } }
I20260810 04:15:31.018555 32618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:31.018612 32619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 427bb7dcc0f2483cbe39acbd1a3d8a55. Latest consensus state: current_term: 1 leader_uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "427bb7dcc0f2483cbe39acbd1a3d8a55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42933 } } }
I20260810 04:15:31.018702 32619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:31.018814 32627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:31.019375 32627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:31.020829 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 32543
I20260810 04:15:31.020946 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:31.021119 11238 external_mini_cluster.cc:1428] Setting key c0689e09897d7a0bdf031599373721f8
I20260810 04:15:31.021325 32627 catalog_manager.cc:1347] Generated new cluster ID: af26b11a49ad4739a6b14f9709ec4b0f
I20260810 04:15:31.021380 32627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:31.027025 32627 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:31.027570 32627 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:31.033022 32627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 427bb7dcc0f2483cbe39acbd1a3d8a55: Generated new TSK 0
Aug 10 04:15:31 dist-test-slave-0kls krb5kdc[32530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 04:15:31.033188 32627 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:31.036603 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:31.021585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52591 (local address 127.0.0.1:42933)
0810 04:15:31.021736 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:31.021748 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:31.026781 (+ 5033us) server_negotiation.cc:407] Connection header received
0810 04:15:31.026928 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:31.026935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:31.026988 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:31.027131 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:31.027930 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:31.029253 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:31.030397 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:31.030957 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:31.031049 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:31.033645 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:31.033649 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:31.033649 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:31.033660 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:31.035274 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:31.035603 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:31.035606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:31.035607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:31.035700 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:31.035883 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:31.035884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:31.035884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:31.036125 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:31.036247 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:31.036316 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 04:15:31.036403 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
I20260810 04:15:31.037621 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:31.045354 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:31.039088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58655 (local address 127.0.0.1:42933)
0810 04:15:31.039140 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:31.039142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:31.039274 (+ 132us) server_negotiation.cc:407] Connection header received
0810 04:15:31.039328 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:31.039329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:31.039337 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:31.039377 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:31.039994 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:31.040756 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:31.041690 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:31.041901 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:31.041947 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:31.043068 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:31.043069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:31.043069 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:31.043074 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:31.044199 (+ 1125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:31.044630 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:31.044631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:31.044631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:31.044676 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:31.044883 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:31.044884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:31.044884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:31.044966 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:31.045033 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:31.045222 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 04:15:31.045269 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:15:31.047108 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 32543
W20260810 04:15:31.053707 32528 connection.cc:535] client connection to 127.0.0.1:42933 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42933): Connection reset by peer (error 104)
2026-08-10T04:15:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1253 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:31 dist-test-slave-0kls krb5kdc[32649](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:31 dist-test-slave-0kls krb5kdc[32649](info): set up 2 sockets
Aug 10 04:15:31 dist-test-slave-0kls krb5kdc[32649](info): commencing operation
krb5kdc: starting...
W20260810 04:15:32.046248 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.979s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:32 dist-test-slave-0kls krb5kdc[32649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:32.160370 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43425
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:32.239972 32663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:32.240159 32663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:32.240187 32663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:32.241307 32663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:32.241349 32663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:32.241364 32663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:32.241408 32663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:32.241425 32663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:32.242882 32663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43425
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:32.243109 32663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:32.243312 32663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:32.247606 32669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:32.247633 32668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:32.247661 32671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:32.247928 32663 server_base.cc:1034] running on GCE node
I20260810 04:15:32.248190 32663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:32.248472 32663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:32.249614 32663 hybrid_clock.cc:648] HybridClock initialized: now 1786335332249600 us; error 34 us; skew 500 ppm
Aug 10 04:15:32 dist-test-slave-0kls krb5kdc[32649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335332, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:32.251969 32663 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:32.252447 32663 webserver.cc:460] Webserver started at http://127.0.0.1:46717/ using document root <none> and password file <none>
I20260810 04:15:32.252658 32663 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:32.252724 32663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:32.252871 32663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:32.253921 32663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "395eaf3d6745441f8df76c9b24632d6f"
format_stamp: "Formatted at 2026-08-10 04:15:32 on dist-test-slave-0kls"
server_key: "1b0ccf6ccc5516234c91f33205f17bea"
server_key_iv: "02da728c9f19ad59e734fca7db180a45"
server_key_version: "encryptionkey@0"
I20260810 04:15:32.254273 32663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "395eaf3d6745441f8df76c9b24632d6f"
format_stamp: "Formatted at 2026-08-10 04:15:32 on dist-test-slave-0kls"
server_key: "1b0ccf6ccc5516234c91f33205f17bea"
server_key_iv: "02da728c9f19ad59e734fca7db180a45"
server_key_version: "encryptionkey@0"
I20260810 04:15:32.255517 32663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:32.256208 32679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:32.256376 32663 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:32.256492 32663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "395eaf3d6745441f8df76c9b24632d6f"
format_stamp: "Formatted at 2026-08-10 04:15:32 on dist-test-slave-0kls"
server_key: "1b0ccf6ccc5516234c91f33205f17bea"
server_key_iv: "02da728c9f19ad59e734fca7db180a45"
server_key_version: "encryptionkey@0"
I20260810 04:15:32.256582 32663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:32.288714 32663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:32.290513 32663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:32.290663 32663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:32.294431 32663 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43425
I20260810 04:15:32.294476 32734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43425 every 8 connection(s)
I20260810 04:15:32.294804 32663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:32.295291 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 32663
I20260810 04:15:32.295405 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:32.295590 11238 external_mini_cluster.cc:1428] Setting key 3126e546e67f3c0966bbd9182fdb51c0
I20260810 04:15:32.295800 32735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:32.298830 32735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f: Bootstrap starting.
I20260810 04:15:32.299443 32735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:32.299845 32735 log.cc:824] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:32.300537 32735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f: No bootstrap required, opened a new log
I20260810 04:15:32.301033 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:32.296082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38463 (local address 127.0.0.1:43425)
0810 04:15:32.296248 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:32.296256 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:32.296286 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:15:32.296748 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:32.296755 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:32.296796 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:32.296895 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:32.297107 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:32.298013 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:32.299077 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:32.299468 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:32.299594 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:32.300337 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:32.300341 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:32.300342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:32.300492 (+ 150us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:32.300534 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:32.300545 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:32.300644 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:32.300769 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 04:15:32.300810 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260810 04:15:32.302122 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:32.302810 32735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "395eaf3d6745441f8df76c9b24632d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43425 } }
I20260810 04:15:32.302937 32735 raft_consensus.cc:374] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:32.302960 32735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395eaf3d6745441f8df76c9b24632d6f, State: Initialized, Role: FOLLOWER
I20260810 04:15:32.303121 32735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "395eaf3d6745441f8df76c9b24632d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43425 } }
I20260810 04:15:32.303236 32735 raft_consensus.cc:388] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:32.303297 32735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:32.303354 32735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:32.303942 32735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "395eaf3d6745441f8df76c9b24632d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43425 } }
I20260810 04:15:32.304050 32735 leader_election.cc:302] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 395eaf3d6745441f8df76c9b24632d6f; no voters:
I20260810 04:15:32.304235 32735 leader_election.cc:288] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:32.304268 32745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:32.304473 32745 raft_consensus.cc:686] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [term 1 LEADER]: Becoming Leader. State: Replica: 395eaf3d6745441f8df76c9b24632d6f, State: Running, Role: LEADER
I20260810 04:15:32.304489 32735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:32.304555 32745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "395eaf3d6745441f8df76c9b24632d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43425 } }
I20260810 04:15:32.304885 32745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 395eaf3d6745441f8df76c9b24632d6f. Latest consensus state: current_term: 1 leader_uuid: "395eaf3d6745441f8df76c9b24632d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "395eaf3d6745441f8df76c9b24632d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43425 } } }
I20260810 04:15:32.304973 32745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:32.304893 32747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "395eaf3d6745441f8df76c9b24632d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "395eaf3d6745441f8df76c9b24632d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43425 } } }
I20260810 04:15:32.305197 32747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:32.305163 32752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:32.305737 32752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:32.306792 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:32.303503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56491 (local address 127.0.0.1:43425)
0810 04:15:32.303538 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:32.303540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:32.303657 (+ 117us) server_negotiation.cc:407] Connection header received
0810 04:15:32.303728 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:32.303729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:32.303737 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:32.303789 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:32.303945 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:32.304604 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:32.305564 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:32.305854 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:32.305912 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:32.306578 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:32.306580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:32.306580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:32.306584 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:32.306595 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:32.306599 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:32.306648 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:32.306700 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 04:15:32.306708 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:15:32.307325 32752 catalog_manager.cc:1347] Generated new cluster ID: f62d714245334fa9bb2642ed4817f5e3
I20260810 04:15:32.307371 32752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:32.325964 32752 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:32.326679 32752 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:32.342944 32752 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 395eaf3d6745441f8df76c9b24632d6f: Generated new TSK 0
I20260810 04:15:32.343149 32752 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:32.351743 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 32663
W20260810 04:15:32.357373 32647 connection.cc:535] client connection to 127.0.0.1:43425 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43425): Connection reset by peer (error 104)
2026-08-10T04:15:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1304 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:32 dist-test-slave-0kls krb5kdc[32767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:32 dist-test-slave-0kls krb5kdc[32767](info): set up 2 sockets
Aug 10 04:15:32 dist-test-slave-0kls krb5kdc[32767](info): commencing operation
krb5kdc: starting...
W20260810 04:15:33.322075 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.951s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:33 dist-test-slave-0kls krb5kdc[32767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:33.430716 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36163
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:33.504354 314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:33.504585 314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:33.504616 314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:33.505568 314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:33.505630 314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:33.505648 314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:33.505667 314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:33.505694 314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:33.506944 314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36163
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:33.507230 314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:33.507455 314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:33.512223 320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:33.512216 323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:33.512290 321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:33.512519 314 server_base.cc:1034] running on GCE node
I20260810 04:15:33.512715 314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:33.512956 314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:33.514102 314 hybrid_clock.cc:648] HybridClock initialized: now 1786335333514096 us; error 32 us; skew 500 ppm
Aug 10 04:15:33 dist-test-slave-0kls krb5kdc[32767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335333, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:33.520486 314 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:33.520943 314 webserver.cc:460] Webserver started at http://127.0.0.1:37805/ using document root <none> and password file <none>
I20260810 04:15:33.521103 314 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:33.521137 314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:33.521216 314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:33.522219 314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "bcc766a9a3a043a3b167562a45de6675"
format_stamp: "Formatted at 2026-08-10 04:15:33 on dist-test-slave-0kls"
server_key: "2fcb6175cd46f2255f12f4cce73c5568"
server_key_iv: "a05489644857ea6a850928a1142e7d56"
server_key_version: "encryptionkey@0"
I20260810 04:15:33.522501 314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "bcc766a9a3a043a3b167562a45de6675"
format_stamp: "Formatted at 2026-08-10 04:15:33 on dist-test-slave-0kls"
server_key: "2fcb6175cd46f2255f12f4cce73c5568"
server_key_iv: "a05489644857ea6a850928a1142e7d56"
server_key_version: "encryptionkey@0"
I20260810 04:15:33.523689 314 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:33.524310 330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:33.524480 314 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:33.524559 314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "bcc766a9a3a043a3b167562a45de6675"
format_stamp: "Formatted at 2026-08-10 04:15:33 on dist-test-slave-0kls"
server_key: "2fcb6175cd46f2255f12f4cce73c5568"
server_key_iv: "a05489644857ea6a850928a1142e7d56"
server_key_version: "encryptionkey@0"
I20260810 04:15:33.524605 314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:33.527382 314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:33.528853 314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:33.528941 314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:33.532596 314 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36163
I20260810 04:15:33.532675 386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36163 every 8 connection(s)
I20260810 04:15:33.532931 314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:33.533713 387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:33.534970 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 314
I20260810 04:15:33.535085 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:33.535267 11238 external_mini_cluster.cc:1428] Setting key 05e14b5fe76cd80f7538dee6cd167f42
I20260810 04:15:33.536049 387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675: Bootstrap starting.
I20260810 04:15:33.536697 387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:33.536983 387 log.cc:824] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:33.537628 390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:33.535749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46271 (local address 127.0.0.1:36163)
0810 04:15:33.535919 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:33.535926 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:33.535949 (+ 23us) server_negotiation.cc:407] Connection header received
0810 04:15:33.536397 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:33.536404 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:33.536427 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:33.536530 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:33.537197 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:33.537201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:33.537201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:33.537206 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:33.537245 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:33.537258 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:33.537346 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:33.537380 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 04:15:33.537416 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
I20260810 04:15:33.537667 387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675: No bootstrap required, opened a new log
I20260810 04:15:33.538611 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:33.539875 387 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc766a9a3a043a3b167562a45de6675" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } }
I20260810 04:15:33.540048 387 raft_consensus.cc:374] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:33.540094 387 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcc766a9a3a043a3b167562a45de6675, State: Initialized, Role: FOLLOWER
I20260810 04:15:33.540242 387 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc766a9a3a043a3b167562a45de6675" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } }
I20260810 04:15:33.540359 387 raft_consensus.cc:388] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:33.540405 387 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:33.540453 387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:33.540971 387 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc766a9a3a043a3b167562a45de6675" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } }
I20260810 04:15:33.541079 387 leader_election.cc:302] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcc766a9a3a043a3b167562a45de6675; no voters:
I20260810 04:15:33.541230 387 leader_election.cc:288] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:33.541318 397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:33.541440 387 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:33.541462 397 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [term 1 LEADER]: Becoming Leader. State: Replica: bcc766a9a3a043a3b167562a45de6675, State: Running, Role: LEADER
I20260810 04:15:33.541577 397 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc766a9a3a043a3b167562a45de6675" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } }
I20260810 04:15:33.542003 399 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcc766a9a3a043a3b167562a45de6675. Latest consensus state: current_term: 1 leader_uuid: "bcc766a9a3a043a3b167562a45de6675" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc766a9a3a043a3b167562a45de6675" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } } }
I20260810 04:15:33.542014 398 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcc766a9a3a043a3b167562a45de6675" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcc766a9a3a043a3b167562a45de6675" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36163 } } }
I20260810 04:15:33.542161 399 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:33.542174 398 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675 [sys.catalog]: This master's current role is: LEADER
W20260810 04:15:33.543471 412 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:33.543531 412 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:33.543587 406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:33.543807 406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:33.544008 390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:33.540260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57867 (local address 127.0.0.1:36163)
0810 04:15:33.540305 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:33.540307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:33.543027 (+ 2720us) server_negotiation.cc:407] Connection header received
0810 04:15:33.543108 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:33.543108 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:33.543113 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:33.543158 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:33.543775 (+ 617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:33.543776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:33.543776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:33.543780 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:33.543793 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:33.543797 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:33.543862 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:33.543939 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 04:15:33.543953 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:15:33.545279 406 catalog_manager.cc:1347] Generated new cluster ID: 0d232514af1f4ba381911f48f1e8ce28
I20260810 04:15:33.545334 406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:33.562203 406 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:33.562417 406 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:33.567006 406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bcc766a9a3a043a3b167562a45de6675: Generated new TSK 0
I20260810 04:15:33.567170 406 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:33.571802 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 314
2026-08-10T04:15:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1220 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:33 dist-test-slave-0kls krb5kdc[419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:33 dist-test-slave-0kls krb5kdc[419](info): set up 2 sockets
Aug 10 04:15:33 dist-test-slave-0kls krb5kdc[419](info): commencing operation
krb5kdc: starting...
W20260810 04:15:34.534137 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.943s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:34 dist-test-slave-0kls krb5kdc[419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:34.638733 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46421
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:34.709801 432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:34.710083 432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:34.710125 432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:34.711146 432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:34.711206 432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:34.711226 432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:34.711244 432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:34.711268 432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:34.712496 432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:34.712739 432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:34.712944 432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:34.717068 438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:34.717104 437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:34.717072 440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:34.717163 432 server_base.cc:1034] running on GCE node
I20260810 04:15:34.717510 432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:34.717763 432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:34.718951 432 hybrid_clock.cc:648] HybridClock initialized: now 1786335334718939 us; error 27 us; skew 500 ppm
Aug 10 04:15:34 dist-test-slave-0kls krb5kdc[419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335334, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:34.721235 432 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:34.721637 432 webserver.cc:460] Webserver started at http://127.0.0.1:44629/ using document root <none> and password file <none>
I20260810 04:15:34.721886 432 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:34.721944 432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:34.722059 432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:34.723026 432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "296b20ec2c164b1aa41e5c31187a332c"
format_stamp: "Formatted at 2026-08-10 04:15:34 on dist-test-slave-0kls"
server_key: "d468bfae0609c46445ad2e524e8787aa"
server_key_iv: "01dc22c80355e415947def36604b01ec"
server_key_version: "encryptionkey@0"
I20260810 04:15:34.723388 432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "296b20ec2c164b1aa41e5c31187a332c"
format_stamp: "Formatted at 2026-08-10 04:15:34 on dist-test-slave-0kls"
server_key: "d468bfae0609c46445ad2e524e8787aa"
server_key_iv: "01dc22c80355e415947def36604b01ec"
server_key_version: "encryptionkey@0"
I20260810 04:15:34.724821 432 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:15:34.725497 448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:34.725646 432 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:34.725736 432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "296b20ec2c164b1aa41e5c31187a332c"
format_stamp: "Formatted at 2026-08-10 04:15:34 on dist-test-slave-0kls"
server_key: "d468bfae0609c46445ad2e524e8787aa"
server_key_iv: "01dc22c80355e415947def36604b01ec"
server_key_version: "encryptionkey@0"
I20260810 04:15:34.725831 432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:34.745210 432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:34.746658 432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:34.746805 432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:34.750795 432 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46421
I20260810 04:15:34.750823 505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46421 every 8 connection(s)
I20260810 04:15:34.751104 432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:34.751827 506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:34.752799 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 432
I20260810 04:15:34.752935 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:34.753118 11238 external_mini_cluster.cc:1428] Setting key fe4295842c23ee4e6f87047864adad80
I20260810 04:15:34.754244 506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c: Bootstrap starting.
I20260810 04:15:34.754832 506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:34.755129 506 log.cc:824] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:34.755788 506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c: No bootstrap required, opened a new log
I20260810 04:15:34.757715 506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "296b20ec2c164b1aa41e5c31187a332c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } }
I20260810 04:15:34.757890 506 raft_consensus.cc:374] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:34.757943 506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 296b20ec2c164b1aa41e5c31187a332c, State: Initialized, Role: FOLLOWER
I20260810 04:15:34.758057 506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "296b20ec2c164b1aa41e5c31187a332c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } }
I20260810 04:15:34.758127 506 raft_consensus.cc:388] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:34.758172 506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:34.758212 506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:34.758667 506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "296b20ec2c164b1aa41e5c31187a332c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } }
I20260810 04:15:34.758773 506 leader_election.cc:302] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 296b20ec2c164b1aa41e5c31187a332c; no voters:
I20260810 04:15:34.758931 506 leader_election.cc:288] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:34.758965 511 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:34.759091 511 raft_consensus.cc:686] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [term 1 LEADER]: Becoming Leader. State: Replica: 296b20ec2c164b1aa41e5c31187a332c, State: Running, Role: LEADER
I20260810 04:15:34.759179 506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:34.759228 511 consensus_queue.cc:237] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "296b20ec2c164b1aa41e5c31187a332c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } }
Aug 10 04:15:34 dist-test-slave-0kls krb5kdc[419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 04:15:34.759725 512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "296b20ec2c164b1aa41e5c31187a332c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "296b20ec2c164b1aa41e5c31187a332c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } } }
I20260810 04:15:34.759820 512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:34.760053 513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 296b20ec2c164b1aa41e5c31187a332c. Latest consensus state: current_term: 1 leader_uuid: "296b20ec2c164b1aa41e5c31187a332c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "296b20ec2c164b1aa41e5c31187a332c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } } }
I20260810 04:15:34.760181 513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:34.760744 520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:34.761318 520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:34.762722 520 catalog_manager.cc:1347] Generated new cluster ID: 64b292fe22d04ad39a780a161c9b8135
I20260810 04:15:34.762768 520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:34.763613 509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:34.753597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45321 (local address 127.0.0.1:46421)
0810 04:15:34.753773 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:34.753801 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:34.753831 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:15:34.754204 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:34.754210 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:34.754248 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:34.754379 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:34.754994 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:34.756184 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:34.756840 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:34.757417 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:34.757523 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:34.760057 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:34.760062 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:34.760063 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:34.760074 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:34.762158 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:34.762539 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:34.762542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:34.762542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:34.762640 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:34.762837 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:34.762838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:34.762839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:34.763085 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:34.763219 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:34.763330 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 04:15:34.763449 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260810 04:15:34.764434 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:34.772378 509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:34.765713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60301 (local address 127.0.0.1:46421)
0810 04:15:34.765750 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:34.765752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:34.765845 (+ 93us) server_negotiation.cc:407] Connection header received
0810 04:15:34.765907 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:34.765908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:34.765918 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:34.765971 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:34.766500 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:34.767198 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:34.768102 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:34.768419 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:34.768489 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:34.769689 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:34.769690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:34.769690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:34.769697 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:34.771282 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:34.771642 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:34.771643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:34.771643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:34.771702 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:34.771908 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:34.771909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:34.771909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:34.772026 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:34.772116 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:34.772224 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 04:15:34.772293 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:15:34.775830 520 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:34.776361 520 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:34.784319 520 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 296b20ec2c164b1aa41e5c31187a332c: Generated new TSK 0
I20260810 04:15:34.784474 520 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:34.791142 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 432
2026-08-10T04:15:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1218 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:34 dist-test-slave-0kls krb5kdc[539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:34 dist-test-slave-0kls krb5kdc[539](info): set up 2 sockets
Aug 10 04:15:34 dist-test-slave-0kls krb5kdc[539](info): commencing operation
krb5kdc: starting...
W20260810 04:15:35.774101 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.964s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:35 dist-test-slave-0kls krb5kdc[539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:35.883781 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42787
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:35.960373 552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:35.960604 552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:35.960644 552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:35.961655 552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:35.961728 552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:35.961748 552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:35.961766 552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:35.961808 552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:35.963083 552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:35.963322 552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:35.963516 552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:35.967854 561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:35.967918 558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:35.967855 557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:35.967876 552 server_base.cc:1034] running on GCE node
I20260810 04:15:35.968196 552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:35.968406 552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:35.969539 552 hybrid_clock.cc:648] HybridClock initialized: now 1786335335969526 us; error 26 us; skew 500 ppm
Aug 10 04:15:35 dist-test-slave-0kls krb5kdc[539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335335, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:35.971966 552 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:35.972419 552 webserver.cc:460] Webserver started at http://127.0.0.1:42201/ using document root <none> and password file <none>
I20260810 04:15:35.972656 552 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:35.972704 552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:35.972841 552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:35.973737 552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "bcaa6925624045f990a5fea5a960caf9"
format_stamp: "Formatted at 2026-08-10 04:15:35 on dist-test-slave-0kls"
server_key: "5bc3e66c26eb1882ccc3b75e16e75970"
server_key_iv: "4b1ec7672f558a30f6bc30c5d1d64170"
server_key_version: "encryptionkey@0"
I20260810 04:15:35.974159 552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "bcaa6925624045f990a5fea5a960caf9"
format_stamp: "Formatted at 2026-08-10 04:15:35 on dist-test-slave-0kls"
server_key: "5bc3e66c26eb1882ccc3b75e16e75970"
server_key_iv: "4b1ec7672f558a30f6bc30c5d1d64170"
server_key_version: "encryptionkey@0"
I20260810 04:15:35.975333 552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:35.975934 569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:35.976099 552 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:35.976186 552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "bcaa6925624045f990a5fea5a960caf9"
format_stamp: "Formatted at 2026-08-10 04:15:35 on dist-test-slave-0kls"
server_key: "5bc3e66c26eb1882ccc3b75e16e75970"
server_key_iv: "4b1ec7672f558a30f6bc30c5d1d64170"
server_key_version: "encryptionkey@0"
I20260810 04:15:35.976253 552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:35.985363 552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:35.987013 552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:35.987156 552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:35.991004 552 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42787
I20260810 04:15:35.991043 629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42787 every 8 connection(s)
I20260810 04:15:35.991324 552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:35.992067 630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:35.993974 630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9: Bootstrap starting.
I20260810 04:15:35.994477 630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:35.994727 630 log.cc:824] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:35.995347 630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9: No bootstrap required, opened a new log
I20260810 04:15:35.996762 630 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcaa6925624045f990a5fea5a960caf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42787 } }
I20260810 04:15:35.996876 630 raft_consensus.cc:374] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:35.996896 630 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcaa6925624045f990a5fea5a960caf9, State: Initialized, Role: FOLLOWER
I20260810 04:15:35.997035 630 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcaa6925624045f990a5fea5a960caf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42787 } }
I20260810 04:15:35.997108 630 raft_consensus.cc:388] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:35.997128 630 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:35.997160 630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:35.997575 630 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcaa6925624045f990a5fea5a960caf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42787 } }
I20260810 04:15:35.997659 630 leader_election.cc:302] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcaa6925624045f990a5fea5a960caf9; no voters:
I20260810 04:15:35.997850 630 leader_election.cc:288] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:35.997881 633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:35.997903 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 552
I20260810 04:15:35.998008 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:35.998044 633 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [term 1 LEADER]: Becoming Leader. State: Replica: bcaa6925624045f990a5fea5a960caf9, State: Running, Role: LEADER
I20260810 04:15:35.998098 630 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:35.998117 633 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcaa6925624045f990a5fea5a960caf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42787 } }
I20260810 04:15:35.998181 11238 external_mini_cluster.cc:1428] Setting key 71e9cc460cc132a8e6e99d743ccd735a
I20260810 04:15:35.998564 635 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcaa6925624045f990a5fea5a960caf9. Latest consensus state: current_term: 1 leader_uuid: "bcaa6925624045f990a5fea5a960caf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcaa6925624045f990a5fea5a960caf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42787 } } }
I20260810 04:15:35.998639 635 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:35.998806 634 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcaa6925624045f990a5fea5a960caf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcaa6925624045f990a5fea5a960caf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42787 } } }
I20260810 04:15:35.998867 634 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:35.998924 646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:35.999516 646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:36.001091 646 catalog_manager.cc:1347] Generated new cluster ID: a56fd63abc2a44638909bc593233b020
I20260810 04:15:36.001139 646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:36.004590 644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:35.998645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55981 (local address 127.0.0.1:42787)
0810 04:15:35.998834 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:35.998842 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:35.999516 (+ 674us) server_negotiation.cc:407] Connection header received
0810 04:15:35.999654 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:35.999661 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:35.999716 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:35.999966 (+ 250us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:36.000190 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:36.001462 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:36.002552 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:36.003082 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:36.003189 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:36.003902 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:36.003906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:36.003906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:36.004081 (+ 175us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:36.004115 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:36.004127 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:36.004182 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:36.004358 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 04:15:36.004414 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
I20260810 04:15:36.005323 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:36.010437 644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:36.007345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38415 (local address 127.0.0.1:42787)
0810 04:15:36.007371 (+ 26us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:36.007373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:36.007514 (+ 141us) server_negotiation.cc:407] Connection header received
0810 04:15:36.007564 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:36.007565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:36.007574 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:36.007621 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:36.007777 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:36.008368 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:36.009166 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:36.009501 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:36.009535 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:36.010197 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:36.010198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:36.010199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:36.010203 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:36.010214 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:36.010218 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:36.010243 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:36.010338 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 04:15:36.010360 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12}
I20260810 04:15:36.024729 646 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:36.025359 646 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:36.031718 646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bcaa6925624045f990a5fea5a960caf9: Generated new TSK 0
I20260810 04:15:36.031920 646 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:36.040863 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 552
2026-08-10T04:15:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1250 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:36 dist-test-slave-0kls krb5kdc[663](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:36 dist-test-slave-0kls krb5kdc[663](info): set up 2 sockets
Aug 10 04:15:36 dist-test-slave-0kls krb5kdc[663](info): commencing operation
krb5kdc: starting...
W20260810 04:15:37.032732 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.973s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:37 dist-test-slave-0kls krb5kdc[663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:37.138687 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42597
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:37.214344 677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:37.214511 677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:37.214530 677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:37.215442 677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:37.215471 677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:37.215483 677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:37.215493 677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:37.215504 677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:37.216964 677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:37.217173 677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:37.217319 677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:37.221886 682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:37.221915 677 server_base.cc:1034] running on GCE node
W20260810 04:15:37.221863 683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:37.221848 685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:37.222322 677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:37.222559 677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:37.223690 677 hybrid_clock.cc:648] HybridClock initialized: now 1786335337223676 us; error 27 us; skew 500 ppm
Aug 10 04:15:37 dist-test-slave-0kls krb5kdc[663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335337, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:37.225739 677 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:37.226107 677 webserver.cc:460] Webserver started at http://127.0.0.1:37267/ using document root <none> and password file <none>
I20260810 04:15:37.226284 677 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:37.226318 677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:37.226402 677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:37.227334 677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "f9456e4f925242538e95cf6aaf2141fb"
format_stamp: "Formatted at 2026-08-10 04:15:37 on dist-test-slave-0kls"
server_key: "e01a4556acb2b2f9965cefbfbbd6f3b2"
server_key_iv: "4b5cab6958e4e57924a9f3b1ab3d4523"
server_key_version: "encryptionkey@0"
I20260810 04:15:37.227629 677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "f9456e4f925242538e95cf6aaf2141fb"
format_stamp: "Formatted at 2026-08-10 04:15:37 on dist-test-slave-0kls"
server_key: "e01a4556acb2b2f9965cefbfbbd6f3b2"
server_key_iv: "4b5cab6958e4e57924a9f3b1ab3d4523"
server_key_version: "encryptionkey@0"
I20260810 04:15:37.228801 677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:15:37.229444 693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:37.229600 677 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:37.229688 677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "f9456e4f925242538e95cf6aaf2141fb"
format_stamp: "Formatted at 2026-08-10 04:15:37 on dist-test-slave-0kls"
server_key: "e01a4556acb2b2f9965cefbfbbd6f3b2"
server_key_iv: "4b5cab6958e4e57924a9f3b1ab3d4523"
server_key_version: "encryptionkey@0"
I20260810 04:15:37.229743 677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:37.232614 677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:37.234143 677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:37.234241 677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:37.237604 677 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42597
I20260810 04:15:37.237664 748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42597 every 8 connection(s)
I20260810 04:15:37.237942 677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:37.238713 749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:37.240764 749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb: Bootstrap starting.
I20260810 04:15:37.241317 749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:37.241618 749 log.cc:824] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:37.242376 749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb: No bootstrap required, opened a new log
I20260810 04:15:37.242620 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 677
I20260810 04:15:37.242748 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:37.242942 11238 external_mini_cluster.cc:1428] Setting key ca306f7c869898d3bc76c59591fcd998
I20260810 04:15:37.244565 749 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9456e4f925242538e95cf6aaf2141fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42597 } }
I20260810 04:15:37.244738 749 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:37.244769 749 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9456e4f925242538e95cf6aaf2141fb, State: Initialized, Role: FOLLOWER
I20260810 04:15:37.244881 749 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9456e4f925242538e95cf6aaf2141fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42597 } }
I20260810 04:15:37.244952 749 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:37.245034 749 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:37.245308 749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:37.245878 754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:37.243397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53109 (local address 127.0.0.1:42597)
0810 04:15:37.243592 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:37.243601 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:37.243638 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:15:37.244740 (+ 1102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:37.244748 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:37.244780 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:37.244912 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:37.245440 (+ 528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:37.245443 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:37.245443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:37.245448 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:37.245486 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:37.245499 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:37.245572 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:37.245622 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 04:15:37.245659 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260810 04:15:37.246011 749 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9456e4f925242538e95cf6aaf2141fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42597 } }
I20260810 04:15:37.246124 749 leader_election.cc:302] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9456e4f925242538e95cf6aaf2141fb; no voters:
I20260810 04:15:37.246277 749 leader_election.cc:288] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:37.246440 755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:37.246520 749 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:37.246573 755 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [term 1 LEADER]: Becoming Leader. State: Replica: f9456e4f925242538e95cf6aaf2141fb, State: Running, Role: LEADER
I20260810 04:15:37.246686 755 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9456e4f925242538e95cf6aaf2141fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42597 } }
I20260810 04:15:37.246773 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:37.246982 755 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9456e4f925242538e95cf6aaf2141fb. Latest consensus state: current_term: 1 leader_uuid: "f9456e4f925242538e95cf6aaf2141fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9456e4f925242538e95cf6aaf2141fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42597 } } }
I20260810 04:15:37.247043 755 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:37.247184 756 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9456e4f925242538e95cf6aaf2141fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9456e4f925242538e95cf6aaf2141fb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42597 } } }
I20260810 04:15:37.247236 756 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb [sys.catalog]: This master's current role is: LEADER
W20260810 04:15:37.248412 776 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:37.248468 776 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:37.248564 764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:37.248760 764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:37.249274 754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:37.248213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48857 (local address 127.0.0.1:42597)
0810 04:15:37.248249 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:37.248251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:37.248391 (+ 140us) server_negotiation.cc:407] Connection header received
0810 04:15:37.248453 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:37.248453 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:37.248457 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:37.248521 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:37.249047 (+ 526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:37.249048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:37.249048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:37.249052 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:37.249064 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:37.249067 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:37.249119 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:37.249180 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 04:15:37.249193 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:15:37.250249 764 catalog_manager.cc:1347] Generated new cluster ID: 873d59aec04a4d35a436eeb52fc6d878
I20260810 04:15:37.250304 764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:37.265985 764 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:37.266201 764 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:37.269302 764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9456e4f925242538e95cf6aaf2141fb: Generated new TSK 0
I20260810 04:15:37.269503 764 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:37.273648 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 677
2026-08-10T04:15:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1232 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:37 dist-test-slave-0kls krb5kdc[783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:37 dist-test-slave-0kls krb5kdc[783](info): set up 2 sockets
Aug 10 04:15:37 dist-test-slave-0kls krb5kdc[783](info): commencing operation
krb5kdc: starting...
W20260810 04:15:38.312553 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:38 dist-test-slave-0kls krb5kdc[783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:38.430546 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38979
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:38.507196 798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:38.507411 798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:38.507447 798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:38.508471 798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:38.508543 798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:38.508564 798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:38.508584 798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:38.508612 798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:38.510032 798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:38.510318 798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:38.510556 798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:38.515314 806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:38.515316 803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:38.515350 804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:38.515575 798 server_base.cc:1034] running on GCE node
I20260810 04:15:38.515803 798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:38.516018 798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:38.517195 798 hybrid_clock.cc:648] HybridClock initialized: now 1786335338517190 us; error 39 us; skew 500 ppm
Aug 10 04:15:38 dist-test-slave-0kls krb5kdc[783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335338, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:38.519542 798 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:38.520067 798 webserver.cc:460] Webserver started at http://127.0.0.1:43655/ using document root <none> and password file <none>
I20260810 04:15:38.520254 798 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:38.520293 798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:38.520380 798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:38.521322 798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "45511051eefb4c7da7ec09bd610eb4b4"
format_stamp: "Formatted at 2026-08-10 04:15:38 on dist-test-slave-0kls"
server_key: "ea332824bdea0edb6e60835671a5947a"
server_key_iv: "7b88897c238943fd46b7f6b955a838f6"
server_key_version: "encryptionkey@0"
I20260810 04:15:38.521593 798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "45511051eefb4c7da7ec09bd610eb4b4"
format_stamp: "Formatted at 2026-08-10 04:15:38 on dist-test-slave-0kls"
server_key: "ea332824bdea0edb6e60835671a5947a"
server_key_iv: "7b88897c238943fd46b7f6b955a838f6"
server_key_version: "encryptionkey@0"
I20260810 04:15:38.522918 798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:38.523566 813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:38.523744 798 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:38.523829 798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "45511051eefb4c7da7ec09bd610eb4b4"
format_stamp: "Formatted at 2026-08-10 04:15:38 on dist-test-slave-0kls"
server_key: "ea332824bdea0edb6e60835671a5947a"
server_key_iv: "7b88897c238943fd46b7f6b955a838f6"
server_key_version: "encryptionkey@0"
I20260810 04:15:38.523880 798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:38.540251 798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:38.542402 798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:38.542539 798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:38.546303 798 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38979
I20260810 04:15:38.546360 867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38979 every 8 connection(s)
I20260810 04:15:38.546675 798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:38.547577 868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:38.549860 868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4: Bootstrap starting.
I20260810 04:15:38.550475 868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:38.550776 868 log.cc:824] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:38.551477 868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4: No bootstrap required, opened a new log
I20260810 04:15:38.553071 868 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45511051eefb4c7da7ec09bd610eb4b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38979 } }
I20260810 04:15:38.553239 868 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:38.553287 868 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45511051eefb4c7da7ec09bd610eb4b4, State: Initialized, Role: FOLLOWER
I20260810 04:15:38.553471 868 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45511051eefb4c7da7ec09bd610eb4b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38979 } }
I20260810 04:15:38.553575 868 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:38.553638 868 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:38.553694 868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:38.554255 868 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45511051eefb4c7da7ec09bd610eb4b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38979 } }
I20260810 04:15:38.554379 868 leader_election.cc:302] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45511051eefb4c7da7ec09bd610eb4b4; no voters:
I20260810 04:15:38.554560 868 leader_election.cc:288] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:38.554601 871 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:38.554780 871 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [term 1 LEADER]: Becoming Leader. State: Replica: 45511051eefb4c7da7ec09bd610eb4b4, State: Running, Role: LEADER
I20260810 04:15:38.554833 868 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:38.554894 871 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45511051eefb4c7da7ec09bd610eb4b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38979 } }
I20260810 04:15:38.555285 873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45511051eefb4c7da7ec09bd610eb4b4. Latest consensus state: current_term: 1 leader_uuid: "45511051eefb4c7da7ec09bd610eb4b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45511051eefb4c7da7ec09bd610eb4b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38979 } } }
I20260810 04:15:38.555362 873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:38.555406 872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45511051eefb4c7da7ec09bd610eb4b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45511051eefb4c7da7ec09bd610eb4b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38979 } } }
I20260810 04:15:38.555431 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 798
I20260810 04:15:38.555459 872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:38.555531 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:38.555724 11238 external_mini_cluster.cc:1428] Setting key c019020e97c024f1444aa97c5b8fbe50
I20260810 04:15:38.555903 875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:38.556639 875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:38.558305 875 catalog_manager.cc:1347] Generated new cluster ID: 1756a51427c54f0f95654e142500f8b3
I20260810 04:15:38.558375 875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:15:38 dist-test-slave-0kls krb5kdc[783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 04:15:38.568042 885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:38.556158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:59777 (local address 127.0.0.1:38979)
0810 04:15:38.556952 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:38.556961 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:38.556991 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:15:38.557258 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:38.557266 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:38.557328 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:38.557500 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:38.558351 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:38.559738 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:38.560859 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:38.561504 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:38.561610 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:38.564323 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:38.564329 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:38.564329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:38.564341 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:38.566303 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:38.566742 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:38.566745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:38.566746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:38.566889 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:38.567131 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:38.567132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:38.567132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:38.567426 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:38.567600 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:38.567714 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 04:15:38.567818 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":80,"threads_started":1}
I20260810 04:15:38.568987 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:38.577011 885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:38.570413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:46487 (local address 127.0.0.1:38979)
0810 04:15:38.570451 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:38.570453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:38.570560 (+ 107us) server_negotiation.cc:407] Connection header received
0810 04:15:38.570626 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:38.570627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:38.570636 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:38.570689 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:38.571253 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:38.571911 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:38.572816 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:38.573069 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:38.573118 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:38.574384 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:38.574385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:38.574386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:38.574392 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:38.575874 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:38.576282 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:38.576283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:38.576284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:38.576335 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:38.576564 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:38.576564 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:38.576564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:38.576669 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:38.576760 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:38.576885 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 04:15:38.576938 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:15:38.583457 875 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:38.583890 875 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:38.585493 875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45511051eefb4c7da7ec09bd610eb4b4: Generated new TSK 0
I20260810 04:15:38.585644 875 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:38.591459 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 798
W20260810 04:15:38.598323 781 connection.cc:535] client connection to 127.0.0.1:38979 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38979): Connection reset by peer (error 104)
2026-08-10T04:15:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1319 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:38 dist-test-slave-0kls krb5kdc[902](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:38 dist-test-slave-0kls krb5kdc[902](info): set up 2 sockets
Aug 10 04:15:38 dist-test-slave-0kls krb5kdc[902](info): commencing operation
krb5kdc: starting...
W20260810 04:15:39.648545 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:39 dist-test-slave-0kls krb5kdc[902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:39.770541 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42251
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:39.854426 916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:39.854637 916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:39.854660 916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:39.855913 916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:39.855952 916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:39.855967 916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:39.855979 916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:39.855991 916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:39.857595 916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:39.857878 916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:39.858117 916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:39.863020 921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:39.863005 922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:39.863286 916 server_base.cc:1034] running on GCE node
W20260810 04:15:39.863003 924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:39.863572 916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:39.863915 916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:39.865088 916 hybrid_clock.cc:648] HybridClock initialized: now 1786335339865074 us; error 36 us; skew 500 ppm
Aug 10 04:15:39 dist-test-slave-0kls krb5kdc[902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335339, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:39.867637 916 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:39.868122 916 webserver.cc:460] Webserver started at http://127.0.0.1:39781/ using document root <none> and password file <none>
I20260810 04:15:39.868389 916 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:39.868458 916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:39.868607 916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:39.869849 916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "4059e0defe4643b9a461f96795d1ee20"
format_stamp: "Formatted at 2026-08-10 04:15:39 on dist-test-slave-0kls"
server_key: "34536533f0457fc36fe97774aea2d86d"
server_key_iv: "1a492fc26eb21376d92dc7febc592fd9"
server_key_version: "encryptionkey@0"
I20260810 04:15:39.870244 916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "4059e0defe4643b9a461f96795d1ee20"
format_stamp: "Formatted at 2026-08-10 04:15:39 on dist-test-slave-0kls"
server_key: "34536533f0457fc36fe97774aea2d86d"
server_key_iv: "1a492fc26eb21376d92dc7febc592fd9"
server_key_version: "encryptionkey@0"
I20260810 04:15:39.871573 916 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:15:39.872284 931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:39.872457 916 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:15:39.872565 916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "4059e0defe4643b9a461f96795d1ee20"
format_stamp: "Formatted at 2026-08-10 04:15:39 on dist-test-slave-0kls"
server_key: "34536533f0457fc36fe97774aea2d86d"
server_key_iv: "1a492fc26eb21376d92dc7febc592fd9"
server_key_version: "encryptionkey@0"
I20260810 04:15:39.872640 916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:39.904847 916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:39.907027 916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:39.907212 916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:39.911769 916 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42251
I20260810 04:15:39.911899 986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42251 every 8 connection(s)
I20260810 04:15:39.912247 916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:39.913251 987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:39.915709 987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20: Bootstrap starting.
I20260810 04:15:39.916322 987 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:39.916524 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 916
I20260810 04:15:39.916648 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:39.916662 987 log.cc:824] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:39.916852 11238 external_mini_cluster.cc:1428] Setting key 1e794f19da6f55e945c35d5e8488f247
I20260810 04:15:39.917560 987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20: No bootstrap required, opened a new log
I20260810 04:15:39.920249 987 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4059e0defe4643b9a461f96795d1ee20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260810 04:15:39.920435 987 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:39.920471 987 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4059e0defe4643b9a461f96795d1ee20, State: Initialized, Role: FOLLOWER
I20260810 04:15:39.920600 987 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4059e0defe4643b9a461f96795d1ee20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260810 04:15:39.920711 987 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:39.920778 987 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:39.920830 987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:39.921531 987 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4059e0defe4643b9a461f96795d1ee20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260810 04:15:39.921654 987 leader_election.cc:302] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4059e0defe4643b9a461f96795d1ee20; no voters:
I20260810 04:15:39.921895 987 leader_election.cc:288] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:39.921924 993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:39.922138 993 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [term 1 LEADER]: Becoming Leader. State: Replica: 4059e0defe4643b9a461f96795d1ee20, State: Running, Role: LEADER
I20260810 04:15:39.922241 993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4059e0defe4643b9a461f96795d1ee20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260810 04:15:39.922262 987 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:39.922598 996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4059e0defe4643b9a461f96795d1ee20. Latest consensus state: current_term: 1 leader_uuid: "4059e0defe4643b9a461f96795d1ee20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4059e0defe4643b9a461f96795d1ee20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } } }
I20260810 04:15:39.922677 996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:39.922844 995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4059e0defe4643b9a461f96795d1ee20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4059e0defe4643b9a461f96795d1ee20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } } }
I20260810 04:15:39.922899 995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:39.923146 992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:39.917457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:40055 (local address 127.0.0.1:42251)
0810 04:15:39.917621 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:39.917631 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:39.917667 (+ 36us) server_negotiation.cc:407] Connection header received
0810 04:15:39.918153 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:39.918167 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:39.918218 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:39.918332 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:39.918585 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:39.919456 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:39.920645 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:39.921197 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:39.921280 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:39.922340 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:39.922344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:39.922344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:39.922592 (+ 248us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:39.922633 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:39.922649 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:39.922713 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:39.922889 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 04:15:39.922925 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":76,"threads_started":1}
I20260810 04:15:39.924491 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 04:15:39.924664 1010 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:39.924724 1010 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:39.924805 998 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:39.925050 998 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:39.926877 998 catalog_manager.cc:1347] Generated new cluster ID: e3712e565eff4b6fb6ce048dfbdb4526
I20260810 04:15:39.926930 998 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:39.929842 992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:39.926134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:58033 (local address 127.0.0.1:42251)
0810 04:15:39.926192 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:39.926194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:39.926339 (+ 145us) server_negotiation.cc:407] Connection header received
0810 04:15:39.926448 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:39.926449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:39.926460 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:39.926543 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:39.926717 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:39.927457 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:39.928450 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:39.928760 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:39.928837 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:39.929561 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:39.929563 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:39.929563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:39.929568 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:39.929585 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:39.929590 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:39.929659 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:39.929732 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 04:15:39.929743 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 04:15:39.951115 998 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:39.951670 998 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:39.956035 998 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4059e0defe4643b9a461f96795d1ee20: Generated new TSK 0
I20260810 04:15:39.956249 998 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:39.959472 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 916
W20260810 04:15:39.966150 900 connection.cc:535] client connection to 127.0.0.1:42251 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42251): Connection reset by peer (error 104)
2026-08-10T04:15:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1367 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:40 dist-test-slave-0kls krb5kdc[1020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:40 dist-test-slave-0kls krb5kdc[1020](info): set up 2 sockets
Aug 10 04:15:40 dist-test-slave-0kls krb5kdc[1020](info): commencing operation
krb5kdc: starting...
W20260810 04:15:41.020803 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:41 dist-test-slave-0kls krb5kdc[1020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:41.140206 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46209
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46209
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:41.224673 1034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:41.224891 1034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:41.224915 1034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:41.226150 1034 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:41.226281 1034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:41.226343 1034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:41.226375 1034 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:41.226399 1034 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:41.227876 1034 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:41.228085 1034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:41.228271 1034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:41.233381 1040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:41.233381 1042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:41.233407 1039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:41.233522 1034 server_base.cc:1034] running on GCE node
I20260810 04:15:41.233929 1034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:41.234261 1034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:41.235407 1034 hybrid_clock.cc:648] HybridClock initialized: now 1786335341235385 us; error 37 us; skew 500 ppm
Aug 10 04:15:41 dist-test-slave-0kls krb5kdc[1020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335341, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:41.237998 1034 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:41.238440 1034 webserver.cc:460] Webserver started at http://127.0.0.1:35309/ using document root <none> and password file <none>
I20260810 04:15:41.238641 1034 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:41.238685 1034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:41.238782 1034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:41.239886 1034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "9f79ff4bc1d6420b9afb170dafbf7d85"
format_stamp: "Formatted at 2026-08-10 04:15:41 on dist-test-slave-0kls"
server_key: "9a67b046b235b1d09fe6e33f06dd02f7"
server_key_iv: "63a4d78858c176c2f7a03e1e97ec4424"
server_key_version: "encryptionkey@0"
I20260810 04:15:41.240235 1034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "9f79ff4bc1d6420b9afb170dafbf7d85"
format_stamp: "Formatted at 2026-08-10 04:15:41 on dist-test-slave-0kls"
server_key: "9a67b046b235b1d09fe6e33f06dd02f7"
server_key_iv: "63a4d78858c176c2f7a03e1e97ec4424"
server_key_version: "encryptionkey@0"
I20260810 04:15:41.241632 1034 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:41.242530 1049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:41.242743 1034 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:15:41.242848 1034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "9f79ff4bc1d6420b9afb170dafbf7d85"
format_stamp: "Formatted at 2026-08-10 04:15:41 on dist-test-slave-0kls"
server_key: "9a67b046b235b1d09fe6e33f06dd02f7"
server_key_iv: "63a4d78858c176c2f7a03e1e97ec4424"
server_key_version: "encryptionkey@0"
I20260810 04:15:41.242913 1034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:41.246351 1034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:41.248770 1034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:41.248886 1034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:41.253036 1034 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46209
I20260810 04:15:41.253106 1106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46209 every 8 connection(s)
I20260810 04:15:41.253485 1034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:41.254583 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:41.255605 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1034
I20260810 04:15:41.255739 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:41.255929 11238 external_mini_cluster.cc:1428] Setting key b04d9a6c981f9bfab5ccc9152cf728dd
I20260810 04:15:41.258492 1107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85: Bootstrap starting.
I20260810 04:15:41.259063 1110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:41.256565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:47163 (local address 127.0.0.1:46209)
0810 04:15:41.256757 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:41.256768 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:41.256801 (+ 33us) server_negotiation.cc:407] Connection header received
0810 04:15:41.257429 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:41.257440 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:41.257483 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:41.257653 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:41.258487 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:41.258492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:41.258492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:41.258497 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:41.258550 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:41.258567 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:41.258648 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:41.258772 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 04:15:41.258822 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":74,"threads_started":1}
I20260810 04:15:41.259334 1107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:41.259640 1107 log.cc:824] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:41.260187 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:41.260483 1107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85: No bootstrap required, opened a new log
I20260810 04:15:41.263146 1110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:41.261917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:56835 (local address 127.0.0.1:46209)
0810 04:15:41.261976 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:41.261978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:41.262124 (+ 146us) server_negotiation.cc:407] Connection header received
0810 04:15:41.262205 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:41.262206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:41.262211 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:41.262258 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:41.262923 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:41.262924 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:41.262925 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:41.262929 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:41.262944 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:41.262948 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:41.262998 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:41.263088 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 04:15:41.263100 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:15:41.263486 1107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f79ff4bc1d6420b9afb170dafbf7d85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46209 } }
I20260810 04:15:41.263665 1107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:41.263726 1107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f79ff4bc1d6420b9afb170dafbf7d85, State: Initialized, Role: FOLLOWER
I20260810 04:15:41.263863 1107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f79ff4bc1d6420b9afb170dafbf7d85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46209 } }
I20260810 04:15:41.263952 1107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:41.263976 1107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:41.264034 1107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:41.264660 1107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f79ff4bc1d6420b9afb170dafbf7d85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46209 } }
I20260810 04:15:41.264791 1107 leader_election.cc:302] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f79ff4bc1d6420b9afb170dafbf7d85; no voters:
I20260810 04:15:41.264983 1107 leader_election.cc:288] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:41.265021 1117 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:41.265166 1117 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [term 1 LEADER]: Becoming Leader. State: Replica: 9f79ff4bc1d6420b9afb170dafbf7d85, State: Running, Role: LEADER
I20260810 04:15:41.265314 1107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:41.265297 1117 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f79ff4bc1d6420b9afb170dafbf7d85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46209 } }
I20260810 04:15:41.265702 1119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f79ff4bc1d6420b9afb170dafbf7d85. Latest consensus state: current_term: 1 leader_uuid: "9f79ff4bc1d6420b9afb170dafbf7d85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f79ff4bc1d6420b9afb170dafbf7d85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46209 } } }
I20260810 04:15:41.265905 1119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:41.265733 1118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f79ff4bc1d6420b9afb170dafbf7d85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f79ff4bc1d6420b9afb170dafbf7d85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46209 } } }
I20260810 04:15:41.266173 1118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:41.266209 1125 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:41.266759 1125 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:41.268513 1125 catalog_manager.cc:1347] Generated new cluster ID: ff9a1622201e4791b15894784c84d7d0
I20260810 04:15:41.268571 1125 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:41.274430 1125 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:41.274663 1125 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:41.278519 1125 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f79ff4bc1d6420b9afb170dafbf7d85: Generated new TSK 0
I20260810 04:15:41.278764 1125 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:41.285851 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1034
2026-08-10T04:15:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1325 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:41 dist-test-slave-0kls krb5kdc[1139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:41 dist-test-slave-0kls krb5kdc[1139](info): set up 2 sockets
Aug 10 04:15:41 dist-test-slave-0kls krb5kdc[1139](info): commencing operation
krb5kdc: starting...
W20260810 04:15:42.350023 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:42 dist-test-slave-0kls krb5kdc[1139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:42.476333 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40127
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:42.557328 1153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:42.557523 1153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:42.557542 1153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:42.558528 1153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:42.558565 1153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:42.558578 1153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:42.558589 1153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:42.558637 1153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:42.559939 1153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40127
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:42.560192 1153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:42.560415 1153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:42.565533 1161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:42.565526 1159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:42.565621 1153 server_base.cc:1034] running on GCE node
W20260810 04:15:42.565527 1158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:42.566205 1153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:42.566457 1153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:42.567687 1153 hybrid_clock.cc:648] HybridClock initialized: now 1786335342567663 us; error 38 us; skew 500 ppm
Aug 10 04:15:42 dist-test-slave-0kls krb5kdc[1139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335342, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:42.570034 1153 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:42.570498 1153 webserver.cc:460] Webserver started at http://127.0.0.1:33669/ using document root <none> and password file <none>
I20260810 04:15:42.570726 1153 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:42.570796 1153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:42.570956 1153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:42.571924 1153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "f4eb9836c2d14e40a5714cff911ac526"
format_stamp: "Formatted at 2026-08-10 04:15:42 on dist-test-slave-0kls"
server_key: "aabbae4fa5126dcc33436ad8f725634a"
server_key_iv: "2c87bec666826f79c1e1a2d3dfc1e025"
server_key_version: "encryptionkey@0"
I20260810 04:15:42.572283 1153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "f4eb9836c2d14e40a5714cff911ac526"
format_stamp: "Formatted at 2026-08-10 04:15:42 on dist-test-slave-0kls"
server_key: "aabbae4fa5126dcc33436ad8f725634a"
server_key_iv: "2c87bec666826f79c1e1a2d3dfc1e025"
server_key_version: "encryptionkey@0"
I20260810 04:15:42.573463 1153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:15:42.574193 1169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:42.574352 1153 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:42.574452 1153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "f4eb9836c2d14e40a5714cff911ac526"
format_stamp: "Formatted at 2026-08-10 04:15:42 on dist-test-slave-0kls"
server_key: "aabbae4fa5126dcc33436ad8f725634a"
server_key_iv: "2c87bec666826f79c1e1a2d3dfc1e025"
server_key_version: "encryptionkey@0"
I20260810 04:15:42.574522 1153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:42.587090 1153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:42.588722 1153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:42.588876 1153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:42.593031 1153 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40127
I20260810 04:15:42.593053 1224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40127 every 8 connection(s)
I20260810 04:15:42.593375 1153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:42.594295 1225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:42.596480 1225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526: Bootstrap starting.
I20260810 04:15:42.597007 1225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:42.597218 1225 log.cc:824] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:42.597824 1225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526: No bootstrap required, opened a new log
I20260810 04:15:42.599449 1225 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eb9836c2d14e40a5714cff911ac526" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40127 } }
I20260810 04:15:42.599668 1225 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:42.599787 1225 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4eb9836c2d14e40a5714cff911ac526, State: Initialized, Role: FOLLOWER
I20260810 04:15:42.599968 1225 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eb9836c2d14e40a5714cff911ac526" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40127 } }
I20260810 04:15:42.600046 1225 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:42.600100 1225 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:42.600152 1225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:42.600647 1225 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eb9836c2d14e40a5714cff911ac526" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40127 } }
I20260810 04:15:42.600768 1225 leader_election.cc:302] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4eb9836c2d14e40a5714cff911ac526; no voters:
I20260810 04:15:42.600945 1225 leader_election.cc:288] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:42.601003 1228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:42.601150 1228 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [term 1 LEADER]: Becoming Leader. State: Replica: f4eb9836c2d14e40a5714cff911ac526, State: Running, Role: LEADER
I20260810 04:15:42.601191 1225 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:42.601294 1228 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eb9836c2d14e40a5714cff911ac526" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40127 } }
I20260810 04:15:42.601817 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1153
I20260810 04:15:42.601938 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:42.601883 1230 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4eb9836c2d14e40a5714cff911ac526. Latest consensus state: current_term: 1 leader_uuid: "f4eb9836c2d14e40a5714cff911ac526" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eb9836c2d14e40a5714cff911ac526" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40127 } } }
I20260810 04:15:42.601975 1230 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:42.602145 11238 external_mini_cluster.cc:1428] Setting key 809184658f3847e6196940f2dd0f4960
I20260810 04:15:42.602329 1229 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4eb9836c2d14e40a5714cff911ac526" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4eb9836c2d14e40a5714cff911ac526" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40127 } } }
I20260810 04:15:42.602386 1238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:42.602413 1229 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:42.602937 1238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:42.604676 1238 catalog_manager.cc:1347] Generated new cluster ID: 63e2b5ec7759469d973c71ca8b522ad4
I20260810 04:15:42.604739 1238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:42.609603 1238 catalog_manager.cc:1370] Generated new certificate authority record
Aug 10 04:15:42 dist-test-slave-0kls krb5kdc[1139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 04:15:42.610394 1238 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:42.614272 1247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:42.602853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:55607 (local address 127.0.0.1:40127)
0810 04:15:42.603102 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:42.603112 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:42.603144 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:15:42.603258 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:42.603265 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:42.603324 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:42.603471 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:42.604392 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:42.605788 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:42.606904 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:42.607536 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:42.607668 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:42.610538 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:42.610542 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:42.610543 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:42.610556 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:42.612563 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:42.613003 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:42.613006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:42.613007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:42.613120 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:42.613352 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:42.613353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:42.613353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:42.613641 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:42.613861 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:42.613943 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 04:15:42.614046 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":202,"thread_start_us":84,"threads_started":1}
I20260810 04:15:42.615435 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:42.617601 1238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4eb9836c2d14e40a5714cff911ac526: Generated new TSK 0
I20260810 04:15:42.617780 1238 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:42.623417 1247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:42.616900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:54671 (local address 127.0.0.1:40127)
0810 04:15:42.616954 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:42.616956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:42.617062 (+ 106us) server_negotiation.cc:407] Connection header received
0810 04:15:42.617104 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:42.617105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:42.617116 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:42.617166 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:42.617856 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:42.618627 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:42.619282 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:42.619636 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:42.619714 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:42.620806 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:42.620807 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:42.620807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:42.620814 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:42.622338 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:42.622685 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:42.622687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:42.622687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:42.622745 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:42.622947 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:42.622948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:42.622948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:42.623071 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:42.623174 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:42.623267 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 04:15:42.623329 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:15:42.625367 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1153
W20260810 04:15:42.633769 1137 connection.cc:535] client connection to 127.0.0.1:40127 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40127): Connection reset by peer (error 104)
2026-08-10T04:15:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1341 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:42 dist-test-slave-0kls krb5kdc[1257](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:42 dist-test-slave-0kls krb5kdc[1257](info): set up 2 sockets
Aug 10 04:15:42 dist-test-slave-0kls krb5kdc[1257](info): commencing operation
krb5kdc: starting...
W20260810 04:15:43.684778 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:43 dist-test-slave-0kls krb5kdc[1257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:43.816391 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32821
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:43.900153 1271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:43.900429 1271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:43.900470 1271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:43.901644 1271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:43.901721 1271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:43.901743 1271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:43.901762 1271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:43.901788 1271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:43.903301 1271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32821
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:43.903594 1271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:43.903829 1271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:43.908990 1277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:43.909050 1276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:43.908996 1279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:43.909207 1271 server_base.cc:1034] running on GCE node
I20260810 04:15:43.909513 1271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:43.909943 1271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:43.911091 1271 hybrid_clock.cc:648] HybridClock initialized: now 1786335343911066 us; error 42 us; skew 500 ppm
Aug 10 04:15:43 dist-test-slave-0kls krb5kdc[1257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335343, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:43.918210 1271 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:43.918690 1271 webserver.cc:460] Webserver started at http://127.0.0.1:37849/ using document root <none> and password file <none>
I20260810 04:15:43.918951 1271 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:43.919021 1271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:43.919173 1271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:43.920293 1271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "8219d30bdd5e452590f52b5d3b4130ce"
format_stamp: "Formatted at 2026-08-10 04:15:43 on dist-test-slave-0kls"
server_key: "8ce8f1f872431819149fa46ca36ab636"
server_key_iv: "0267ec04c2d47fadbef655018a3d96fa"
server_key_version: "encryptionkey@0"
I20260810 04:15:43.920660 1271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "8219d30bdd5e452590f52b5d3b4130ce"
format_stamp: "Formatted at 2026-08-10 04:15:43 on dist-test-slave-0kls"
server_key: "8ce8f1f872431819149fa46ca36ab636"
server_key_iv: "0267ec04c2d47fadbef655018a3d96fa"
server_key_version: "encryptionkey@0"
I20260810 04:15:43.922091 1271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:15:43.922829 1286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:43.922993 1271 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:43.923102 1271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "8219d30bdd5e452590f52b5d3b4130ce"
format_stamp: "Formatted at 2026-08-10 04:15:43 on dist-test-slave-0kls"
server_key: "8ce8f1f872431819149fa46ca36ab636"
server_key_iv: "0267ec04c2d47fadbef655018a3d96fa"
server_key_version: "encryptionkey@0"
I20260810 04:15:43.923195 1271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:43.931988 1271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:43.933751 1271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:43.933957 1271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:43.937878 1271 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32821
I20260810 04:15:43.937916 1340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32821 every 8 connection(s)
I20260810 04:15:43.938230 1271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:43.939056 1342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:43.941196 1342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce: Bootstrap starting.
I20260810 04:15:43.941692 1342 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:43.942001 1342 log.cc:824] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:43.942214 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1271
I20260810 04:15:43.942334 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:43.942525 11238 external_mini_cluster.cc:1428] Setting key a6c2dbd2586932333eb58e4689409c1c
I20260810 04:15:43.942667 1342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce: No bootstrap required, opened a new log
I20260810 04:15:43.944340 1342 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8219d30bdd5e452590f52b5d3b4130ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } }
I20260810 04:15:43.944489 1342 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:43.944525 1342 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8219d30bdd5e452590f52b5d3b4130ce, State: Initialized, Role: FOLLOWER
I20260810 04:15:43.944720 1342 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8219d30bdd5e452590f52b5d3b4130ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } }
I20260810 04:15:43.944805 1342 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:43.944828 1342 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:43.944893 1342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:43.945385 1342 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8219d30bdd5e452590f52b5d3b4130ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } }
I20260810 04:15:43.945463 1342 leader_election.cc:302] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8219d30bdd5e452590f52b5d3b4130ce; no voters:
I20260810 04:15:43.945672 1347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:43.945649 1342 leader_election.cc:288] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:43.945885 1347 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [term 1 LEADER]: Becoming Leader. State: Replica: 8219d30bdd5e452590f52b5d3b4130ce, State: Running, Role: LEADER
I20260810 04:15:43.946022 1347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8219d30bdd5e452590f52b5d3b4130ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } }
I20260810 04:15:43.946025 1342 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:43.946455 1348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8219d30bdd5e452590f52b5d3b4130ce. Latest consensus state: current_term: 1 leader_uuid: "8219d30bdd5e452590f52b5d3b4130ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8219d30bdd5e452590f52b5d3b4130ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } } }
I20260810 04:15:43.946521 1348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:43.947664 1349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8219d30bdd5e452590f52b5d3b4130ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8219d30bdd5e452590f52b5d3b4130ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } } }
I20260810 04:15:43.948618 1349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce [sys.catalog]: This master's current role is: LEADER
W20260810 04:15:43.948069 1367 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:43.948696 1367 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:43.948763 1351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:43.948967 1351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:43.949393 1346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:43.943007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:57409 (local address 127.0.0.1:32821)
0810 04:15:43.943185 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:43.943192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:43.943215 (+ 23us) server_negotiation.cc:407] Connection header received
0810 04:15:43.944325 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:43.944330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:43.944376 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:43.944502 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:43.944752 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:43.946240 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:43.947342 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:43.947822 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:43.947925 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:43.948660 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:43.948664 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:43.948665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:43.948871 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:43.948910 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:43.948928 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:43.949020 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:43.949149 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 04:15:43.949185 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":97,"threads_started":1}
I20260810 04:15:43.950551 1351 catalog_manager.cc:1347] Generated new cluster ID: 8d1a2d21314645e0bd839c3ea67d60cf
I20260810 04:15:43.950600 1351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:43.950615 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:43.956228 1351 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:43.956910 1351 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:43.957064 1346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:43.952127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:48163 (local address 127.0.0.1:32821)
0810 04:15:43.953848 (+ 1721us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:43.953849 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:43.953856 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:15:43.953872 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:43.953872 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:43.953890 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:43.953938 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:43.954111 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:43.954805 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:43.955759 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:43.955981 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:43.956034 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:43.956701 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:43.956702 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:43.956702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:43.956706 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:43.956720 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:43.956724 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:43.956773 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:43.956855 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 04:15:43.956866 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1703}
I20260810 04:15:43.963851 1351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8219d30bdd5e452590f52b5d3b4130ce: Generated new TSK 0
I20260810 04:15:43.964124 1351 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:43.969201 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1271
W20260810 04:15:43.974730 1255 connection.cc:535] client connection to 127.0.0.1:32821 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32821): Connection reset by peer (error 104)
2026-08-10T04:15:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1341 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:44 dist-test-slave-0kls krb5kdc[1377](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:44 dist-test-slave-0kls krb5kdc[1377](info): set up 2 sockets
Aug 10 04:15:44 dist-test-slave-0kls krb5kdc[1377](info): commencing operation
krb5kdc: starting...
W20260810 04:15:45.021109 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:45 dist-test-slave-0kls krb5kdc[1377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:15:45.158252 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34523
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:45.242877 1391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:45.243085 1391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:45.243108 1391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:45.244305 1391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:45.244350 1391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:45.244365 1391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:45.244377 1391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:45.244390 1391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:45.245975 1391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34523
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:45.246232 1391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:45.246472 1391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:45.251361 1396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:45.251361 1399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:45.251443 1397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:45.251747 1391 server_base.cc:1034] running on GCE node
I20260810 04:15:45.251950 1391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:45.252195 1391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:45.253336 1391 hybrid_clock.cc:648] HybridClock initialized: now 1786335345253325 us; error 30 us; skew 500 ppm
Aug 10 04:15:45 dist-test-slave-0kls krb5kdc[1377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:45.255857 1391 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:15:45.256357 1391 webserver.cc:460] Webserver started at http://127.0.0.1:37123/ using document root <none> and password file <none>
I20260810 04:15:45.256604 1391 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:45.256651 1391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:45.256821 1391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:45.257998 1391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "1ea3606af0ef4089b8a9609df9eea064"
format_stamp: "Formatted at 2026-08-10 04:15:45 on dist-test-slave-0kls"
server_key: "8dfe173638404ed320d18f41fe708816"
server_key_iv: "21ba870f1cbebe29262b496ad8145386"
server_key_version: "encryptionkey@0"
I20260810 04:15:45.258395 1391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "1ea3606af0ef4089b8a9609df9eea064"
format_stamp: "Formatted at 2026-08-10 04:15:45 on dist-test-slave-0kls"
server_key: "8dfe173638404ed320d18f41fe708816"
server_key_iv: "21ba870f1cbebe29262b496ad8145386"
server_key_version: "encryptionkey@0"
I20260810 04:15:45.259790 1391 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:45.260612 1407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:45.260804 1391 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:45.260921 1391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "1ea3606af0ef4089b8a9609df9eea064"
format_stamp: "Formatted at 2026-08-10 04:15:45 on dist-test-slave-0kls"
server_key: "8dfe173638404ed320d18f41fe708816"
server_key_iv: "21ba870f1cbebe29262b496ad8145386"
server_key_version: "encryptionkey@0"
I20260810 04:15:45.260998 1391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:45.264580 1391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:45.266630 1391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:45.266806 1391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:45.271104 1391 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34523
I20260810 04:15:45.271144 1463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34523 every 8 connection(s)
I20260810 04:15:45.271504 1391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:45.272511 1464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:45.274405 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1391
I20260810 04:15:45.274535 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:45.274765 11238 external_mini_cluster.cc:1428] Setting key a7d43d1c126a64f90afba56bd45aa23c
I20260810 04:15:45.275717 1464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064: Bootstrap starting.
I20260810 04:15:45.276535 1464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:45.276948 1464 log.cc:824] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:45.277891 1464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064: No bootstrap required, opened a new log
I20260810 04:15:45.277943 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:45.275386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:48235 (local address 127.0.0.1:34523)
0810 04:15:45.275589 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:45.275600 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:45.275640 (+ 40us) server_negotiation.cc:407] Connection header received
0810 04:15:45.276282 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:45.276291 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:45.276332 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:45.276519 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:45.277418 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:45.277422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:45.277423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:45.277427 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:45.277499 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:45.277516 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:45.277616 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:45.277651 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 04:15:45.277700 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":71,"threads_started":1}
I20260810 04:15:45.279065 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:45.280810 1464 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea3606af0ef4089b8a9609df9eea064" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34523 } }
I20260810 04:15:45.281072 1464 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:45.281147 1464 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ea3606af0ef4089b8a9609df9eea064, State: Initialized, Role: FOLLOWER
I20260810 04:15:45.281317 1464 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea3606af0ef4089b8a9609df9eea064" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34523 } }
I20260810 04:15:45.281446 1464 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:45.281494 1464 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:45.281571 1464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:45.282373 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:45.280968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:59941 (local address 127.0.0.1:34523)
0810 04:15:45.281025 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:45.281027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:45.281199 (+ 172us) server_negotiation.cc:407] Connection header received
0810 04:15:45.281254 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:45.281255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:45.281262 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:45.281345 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:45.282106 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:45.282107 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:45.282107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:45.282111 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:45.282129 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:45.282133 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:45.282186 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:45.282269 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 04:15:45.282281 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:15:45.282505 1464 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea3606af0ef4089b8a9609df9eea064" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34523 } }
I20260810 04:15:45.282656 1464 leader_election.cc:302] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ea3606af0ef4089b8a9609df9eea064; no voters:
I20260810 04:15:45.282825 1464 leader_election.cc:288] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:45.282896 1474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:45.283069 1474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [term 1 LEADER]: Becoming Leader. State: Replica: 1ea3606af0ef4089b8a9609df9eea064, State: Running, Role: LEADER
I20260810 04:15:45.283181 1464 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:45.283222 1474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea3606af0ef4089b8a9609df9eea064" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34523 } }
I20260810 04:15:45.283639 1475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ea3606af0ef4089b8a9609df9eea064" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea3606af0ef4089b8a9609df9eea064" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34523 } } }
I20260810 04:15:45.283747 1477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ea3606af0ef4089b8a9609df9eea064. Latest consensus state: current_term: 1 leader_uuid: "1ea3606af0ef4089b8a9609df9eea064" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ea3606af0ef4089b8a9609df9eea064" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34523 } } }
I20260810 04:15:45.283816 1475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:45.283918 1477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:45.284209 1484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:45.284926 1484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:45.286656 1484 catalog_manager.cc:1347] Generated new cluster ID: 4e66c858fa96496c83c96bcc78f7bf21
I20260810 04:15:45.286736 1484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:45.303617 1484 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:45.303889 1484 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:45.319362 1484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ea3606af0ef4089b8a9609df9eea064: Generated new TSK 0
I20260810 04:15:45.319696 1484 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:45.325724 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1391
2026-08-10T04:15:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1357 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:45 dist-test-slave-0kls krb5kdc[1499](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:45 dist-test-slave-0kls krb5kdc[1499](info): set up 2 sockets
Aug 10 04:15:45 dist-test-slave-0kls krb5kdc[1499](info): commencing operation
krb5kdc: starting...
W20260810 04:15:46.377243 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:46 dist-test-slave-0kls krb5kdc[1499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:46.500739 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42155
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:46211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:42155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:46.581142 1513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:46.581362 1513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:46.581396 1513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:46.582545 1513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:46.582638 1513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:46.582659 1513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:46.582681 1513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:46.582719 1513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:46.584151 1513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:46211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:42155
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:46.584420 1513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:46.584643 1513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:46.589658 1522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:46.589658 1520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:46.589684 1518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:46.589814 1513 server_base.cc:1034] running on GCE node
I20260810 04:15:46.590188 1513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:46.590492 1513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:46.591676 1513 hybrid_clock.cc:648] HybridClock initialized: now 1786335346591667 us; error 38 us; skew 500 ppm
Aug 10 04:15:46 dist-test-slave-0kls krb5kdc[1499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:46.594383 1513 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:46.594895 1513 webserver.cc:460] Webserver started at http://127.10.249.190:46457/ using document root <none> and password file <none>
I20260810 04:15:46.595129 1513 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:46.595196 1513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:46.595340 1513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:46.596407 1513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "3ee8a3d5ce6f4a4cad32758cec764199"
format_stamp: "Formatted at 2026-08-10 04:15:46 on dist-test-slave-0kls"
server_key: "b18f3f5062d0e578ba1a0a19d2bc8daf"
server_key_iv: "35df662b4caf59923955ea5cca61744b"
server_key_version: "encryptionkey@0"
I20260810 04:15:46.596791 1513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "3ee8a3d5ce6f4a4cad32758cec764199"
format_stamp: "Formatted at 2026-08-10 04:15:46 on dist-test-slave-0kls"
server_key: "b18f3f5062d0e578ba1a0a19d2bc8daf"
server_key_iv: "35df662b4caf59923955ea5cca61744b"
server_key_version: "encryptionkey@0"
I20260810 04:15:46.598246 1513 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:46.599016 1529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:46.599198 1513 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:46.599308 1513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "3ee8a3d5ce6f4a4cad32758cec764199"
format_stamp: "Formatted at 2026-08-10 04:15:46 on dist-test-slave-0kls"
server_key: "b18f3f5062d0e578ba1a0a19d2bc8daf"
server_key_iv: "35df662b4caf59923955ea5cca61744b"
server_key_version: "encryptionkey@0"
I20260810 04:15:46.599382 1513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:46.610605 1513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:46.612924 1513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:46.613093 1513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:46.617560 1513 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:42155
I20260810 04:15:46.617622 1582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:42155 every 8 connection(s)
I20260810 04:15:46.618026 1513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:46.618947 1583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:46.621325 1583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199: Bootstrap starting.
I20260810 04:15:46.621956 1583 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:46.622205 1583 log.cc:824] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:46.622885 1583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199: No bootstrap required, opened a new log
I20260810 04:15:46.624425 1583 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee8a3d5ce6f4a4cad32758cec764199" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42155 } }
I20260810 04:15:46.624568 1583 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:46.624591 1583 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ee8a3d5ce6f4a4cad32758cec764199, State: Initialized, Role: FOLLOWER
I20260810 04:15:46.624692 1583 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee8a3d5ce6f4a4cad32758cec764199" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42155 } }
I20260810 04:15:46.624739 1583 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:46.624758 1583 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:46.624787 1583 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:46.625541 1583 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee8a3d5ce6f4a4cad32758cec764199" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42155 } }
I20260810 04:15:46.625664 1583 leader_election.cc:302] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ee8a3d5ce6f4a4cad32758cec764199; no voters:
I20260810 04:15:46.625846 1583 leader_election.cc:288] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:46.625857 1586 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:46.626049 1586 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [term 1 LEADER]: Becoming Leader. State: Replica: 3ee8a3d5ce6f4a4cad32758cec764199, State: Running, Role: LEADER
I20260810 04:15:46.626148 1583 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:46.626214 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1513
I20260810 04:15:46.626240 1586 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee8a3d5ce6f4a4cad32758cec764199" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42155 } }
I20260810 04:15:46.626333 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:46.626510 11238 external_mini_cluster.cc:1428] Setting key 9ba5157a48facf5290302033f896a785
I20260810 04:15:46.626631 1588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ee8a3d5ce6f4a4cad32758cec764199. Latest consensus state: current_term: 1 leader_uuid: "3ee8a3d5ce6f4a4cad32758cec764199" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee8a3d5ce6f4a4cad32758cec764199" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42155 } } }
I20260810 04:15:46.626641 1587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ee8a3d5ce6f4a4cad32758cec764199" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ee8a3d5ce6f4a4cad32758cec764199" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42155 } } }
I20260810 04:15:46.626736 1588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:46.626748 1587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199 [sys.catalog]: This master's current role is: LEADER
W20260810 04:15:46.628316 1605 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:46.628372 1605 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:46.628413 1594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:46.628572 1594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:46.630172 1594 catalog_manager.cc:1347] Generated new cluster ID: 048d6de13f0f411e8eaf769799462d51
I20260810 04:15:46.630228 1594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:15:46 dist-test-slave-0kls krb5kdc[1499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:46.637545 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:46.626997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50107 (local address 127.10.249.190:42155)
0810 04:15:46.627210 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:46.627221 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:46.627349 (+ 128us) server_negotiation.cc:407] Connection header received
0810 04:15:46.627466 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:46.627473 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:46.627530 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:46.627678 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:46.628358 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:46.629438 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:46.630489 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:46.630919 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:46.631036 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:46.633447 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:46.633451 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:46.633452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:46.633465 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:46.635742 (+ 2277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:46.636169 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:46.636172 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:46.636173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:46.636280 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:46.636534 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:46.636535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:46.636535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:46.636790 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:46.636992 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:46.637086 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 04:15:46.637319 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":81,"threads_started":1}
I20260810 04:15:46.638844 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:46.644258 1594 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:46.644984 1594 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:46.648952 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:46.640395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53149 (local address 127.10.249.190:42155)
0810 04:15:46.640435 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:46.640436 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:46.641985 (+ 1549us) server_negotiation.cc:407] Connection header received
0810 04:15:46.642059 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:46.642060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:46.642070 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:46.642126 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:46.642675 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:46.643167 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:46.644097 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:46.644398 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:46.644481 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:46.646045 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:46.646047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:46.646047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:46.646055 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:46.647665 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:46.648104 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:46.648105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:46.648105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:46.648160 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:46.648401 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:46.648401 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:46.648402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:46.648520 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:46.648611 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:46.648810 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 04:15:46.648877 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:15:46.649610 1594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ee8a3d5ce6f4a4cad32758cec764199: Generated new TSK 0
I20260810 04:15:46.649844 1594 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:46.652612 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1513
W20260810 04:15:46.658692 1497 connection.cc:535] client connection to 127.10.249.190:42155 recv error: Network error: failed to read from TLS socket (remote: 127.10.249.190:42155): Connection reset by peer (error 104)
2026-08-10T04:15:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1325 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:46 dist-test-slave-0kls krb5kdc[1615](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:46 dist-test-slave-0kls krb5kdc[1615](info): set up 2 sockets
Aug 10 04:15:46 dist-test-slave-0kls krb5kdc[1615](info): commencing operation
krb5kdc: starting...
W20260810 04:15:47.670935 11238 mini_kdc.cc:121] Time spent starting KDC: real 0.998s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:47 dist-test-slave-0kls krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:47.794654 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:44095
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:40827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:44095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:47.871646 1628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:47.871832 1628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:47.871855 1628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:47.873348 1628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:47.873395 1628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:47.873411 1628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:47.873425 1628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:47.873457 1628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:47.875088 1628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:40827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:44095
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:44095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:47.875327 1628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:47.875555 1628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:47.880214 1633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:47.880205 1634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:47.880205 1636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:47.880425 1628 server_base.cc:1034] running on GCE node
I20260810 04:15:47.880637 1628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:47.880869 1628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:47.882030 1628 hybrid_clock.cc:648] HybridClock initialized: now 1786335347882021 us; error 36 us; skew 500 ppm
Aug 10 04:15:47 dist-test-slave-0kls krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335347, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:47.884310 1628 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:47.884717 1628 webserver.cc:460] Webserver started at http://127.10.249.190:42693/ using document root <none> and password file <none>
I20260810 04:15:47.884948 1628 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:47.885011 1628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:47.885154 1628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:47.886270 1628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "5f448c2b875f4651934d1ac6e17bfb24"
format_stamp: "Formatted at 2026-08-10 04:15:47 on dist-test-slave-0kls"
server_key: "b23a69d5c6ec923bb5111ec79d345649"
server_key_iv: "79c47d6422385ad240f592789f2f340d"
server_key_version: "encryptionkey@0"
I20260810 04:15:47.886636 1628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "5f448c2b875f4651934d1ac6e17bfb24"
format_stamp: "Formatted at 2026-08-10 04:15:47 on dist-test-slave-0kls"
server_key: "b23a69d5c6ec923bb5111ec79d345649"
server_key_iv: "79c47d6422385ad240f592789f2f340d"
server_key_version: "encryptionkey@0"
I20260810 04:15:47.888012 1628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:47.888866 1644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:47.889066 1628 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:47.889187 1628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "5f448c2b875f4651934d1ac6e17bfb24"
format_stamp: "Formatted at 2026-08-10 04:15:47 on dist-test-slave-0kls"
server_key: "b23a69d5c6ec923bb5111ec79d345649"
server_key_iv: "79c47d6422385ad240f592789f2f340d"
server_key_version: "encryptionkey@0"
I20260810 04:15:47.889266 1628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:47.899271 1628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:47.901285 1628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:47.901471 1628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:47.905618 1628 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:44095
I20260810 04:15:47.905700 1698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:44095 every 8 connection(s)
I20260810 04:15:47.906121 1628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:47.907122 1699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:47.908887 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1628
I20260810 04:15:47.908986 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:47.909173 11238 external_mini_cluster.cc:1428] Setting key 981043ffecc6b8119f3b34edb71e7c63
I20260810 04:15:47.910101 1699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24: Bootstrap starting.
I20260810 04:15:47.910844 1699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:47.911252 1699 log.cc:824] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:47.912106 1699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24: No bootstrap required, opened a new log
I20260810 04:15:47.914836 1699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f448c2b875f4651934d1ac6e17bfb24" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44095 } }
I20260810 04:15:47.915050 1699 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:47.915105 1699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f448c2b875f4651934d1ac6e17bfb24, State: Initialized, Role: FOLLOWER
I20260810 04:15:47.915256 1699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f448c2b875f4651934d1ac6e17bfb24" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44095 } }
I20260810 04:15:47.915372 1699 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:47.915439 1699 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:47.915506 1699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:47.915719 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:47.909842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41195 (local address 127.10.249.190:44095)
0810 04:15:47.910034 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:47.910043 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:47.910072 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:15:47.910593 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:47.910603 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:47.910660 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:47.910788 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:47.911136 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:47.912280 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:47.913423 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:47.913932 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:47.914018 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:47.914895 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:47.914899 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:47.914900 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:47.915108 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:47.915158 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:47.915177 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:47.915270 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:47.915414 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 04:15:47.915448 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260810 04:15:47.916365 1699 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f448c2b875f4651934d1ac6e17bfb24" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44095 } }
I20260810 04:15:47.916524 1699 leader_election.cc:302] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f448c2b875f4651934d1ac6e17bfb24; no voters:
I20260810 04:15:47.916740 1699 leader_election.cc:288] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:47.916769 1705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:47.916887 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:47.917042 1699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:47.918023 1705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [term 1 LEADER]: Becoming Leader. State: Replica: 5f448c2b875f4651934d1ac6e17bfb24, State: Running, Role: LEADER
I20260810 04:15:47.918192 1705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f448c2b875f4651934d1ac6e17bfb24" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44095 } }
I20260810 04:15:47.918712 1712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f448c2b875f4651934d1ac6e17bfb24. Latest consensus state: current_term: 1 leader_uuid: "5f448c2b875f4651934d1ac6e17bfb24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f448c2b875f4651934d1ac6e17bfb24" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44095 } } }
I20260810 04:15:47.918800 1712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:47.918898 1706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f448c2b875f4651934d1ac6e17bfb24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f448c2b875f4651934d1ac6e17bfb24" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 44095 } } }
I20260810 04:15:47.919124 1724 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:47.919185 1706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:47.919772 1724 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:47.921767 1724 catalog_manager.cc:1347] Generated new cluster ID: a1d925e17c6444fbb2f1211e6a64d164
I20260810 04:15:47.921852 1724 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:47.927140 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:47.919066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51265 (local address 127.10.249.190:44095)
0810 04:15:47.919113 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:47.919115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:47.919416 (+ 301us) server_negotiation.cc:407] Connection header received
0810 04:15:47.919505 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:47.919506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:47.919520 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:47.919580 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:47.919801 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:47.920327 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:47.921362 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:47.921603 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:47.921714 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:47.926813 (+ 5099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:47.926816 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:47.926816 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:47.926824 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:47.926845 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:47.926850 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:47.926887 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:47.927034 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 04:15:47.927050 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:15:47.934170 1724 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:47.934772 1724 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:47.938985 1724 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f448c2b875f4651934d1ac6e17bfb24: Generated new TSK 0
I20260810 04:15:47.939277 1724 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:47.949772 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1628
W20260810 04:15:47.956959 1613 connection.cc:535] client connection to 127.10.249.190:44095 recv error: Network error: failed to read from TLS socket (remote: 127.10.249.190:44095): Connection reset by peer (error 104)
2026-08-10T04:15:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1298 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:48 dist-test-slave-0kls krb5kdc[1731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:48 dist-test-slave-0kls krb5kdc[1731](info): set up 2 sockets
Aug 10 04:15:48 dist-test-slave-0kls krb5kdc[1731](info): commencing operation
krb5kdc: starting...
W20260810 04:15:48.999817 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:49 dist-test-slave-0kls krb5kdc[1731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:49.118304 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42897
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:42897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:49.200026 1745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:49.200253 1745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:49.200292 1745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:49.201433 1745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:49.201500 1745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:49.201521 1745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:49.201541 1745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:49.201573 1745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:49.203162 1745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:42897
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:42897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:49.203531 1745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:49.203773 1745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:49.208252 1753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:49.208288 1750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:49.208276 1751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:49.208634 1745 server_base.cc:1034] running on GCE node
I20260810 04:15:49.208846 1745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:49.209131 1745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:49.210263 1745 hybrid_clock.cc:648] HybridClock initialized: now 1786335349210251 us; error 26 us; skew 500 ppm
Aug 10 04:15:49 dist-test-slave-0kls krb5kdc[1731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335349, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:49.215878 1745 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:49.216362 1745 webserver.cc:460] Webserver started at http://127.10.249.190:46559/ using document root <none> and password file <none>
I20260810 04:15:49.216555 1745 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:49.216595 1745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:49.216681 1745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:49.217641 1745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "b4b2bf04e2d946b8b71c453de6e37c95"
format_stamp: "Formatted at 2026-08-10 04:15:49 on dist-test-slave-0kls"
server_key: "7eacb42dfb26583ff57a8cfafd06201e"
server_key_iv: "d8fe0d253c57b33d41764197f06e733c"
server_key_version: "encryptionkey@0"
I20260810 04:15:49.218006 1745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "b4b2bf04e2d946b8b71c453de6e37c95"
format_stamp: "Formatted at 2026-08-10 04:15:49 on dist-test-slave-0kls"
server_key: "7eacb42dfb26583ff57a8cfafd06201e"
server_key_iv: "d8fe0d253c57b33d41764197f06e733c"
server_key_version: "encryptionkey@0"
I20260810 04:15:49.219143 1745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:15:49.219826 1760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:49.219996 1745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:15:49.220093 1745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "b4b2bf04e2d946b8b71c453de6e37c95"
format_stamp: "Formatted at 2026-08-10 04:15:49 on dist-test-slave-0kls"
server_key: "7eacb42dfb26583ff57a8cfafd06201e"
server_key_iv: "d8fe0d253c57b33d41764197f06e733c"
server_key_version: "encryptionkey@0"
I20260810 04:15:49.220176 1745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:49.223603 1745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:49.225284 1745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:49.225425 1745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:49.229173 1745 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:42897
I20260810 04:15:49.229210 1815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:42897 every 8 connection(s)
I20260810 04:15:49.229511 1745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:49.230510 1816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:49.232693 1816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95: Bootstrap starting.
I20260810 04:15:49.233285 1816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:49.233474 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1745
I20260810 04:15:49.233597 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:49.233670 1816 log.cc:824] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:49.233870 11238 external_mini_cluster.cc:1428] Setting key 54869e07d10c7215df50a6d0d72c0a34
I20260810 04:15:49.234579 1816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95: No bootstrap required, opened a new log
I20260810 04:15:49.236227 1820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:49.234417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57759 (local address 127.10.249.190:42897)
0810 04:15:49.234595 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:49.234604 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:49.234660 (+ 56us) server_negotiation.cc:407] Connection header received
0810 04:15:49.235089 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:49.235094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:49.235118 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:49.235226 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:49.235800 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:49.235803 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:49.235804 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:49.235808 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:49.235842 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:49.235852 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:49.235916 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:49.235983 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 04:15:49.236034 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
I20260810 04:15:49.237157 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:49.237377 1816 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b2bf04e2d946b8b71c453de6e37c95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42897 } }
I20260810 04:15:49.237497 1816 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:49.237516 1816 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b2bf04e2d946b8b71c453de6e37c95, State: Initialized, Role: FOLLOWER
I20260810 04:15:49.237639 1816 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b2bf04e2d946b8b71c453de6e37c95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42897 } }
I20260810 04:15:49.237716 1816 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:49.237736 1816 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:49.237819 1816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:49.238407 1816 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b2bf04e2d946b8b71c453de6e37c95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42897 } }
I20260810 04:15:49.238520 1816 leader_election.cc:302] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4b2bf04e2d946b8b71c453de6e37c95; no voters:
I20260810 04:15:49.238686 1816 leader_election.cc:288] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:49.238749 1826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:49.238953 1816 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:49.238937 1826 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [term 1 LEADER]: Becoming Leader. State: Replica: b4b2bf04e2d946b8b71c453de6e37c95, State: Running, Role: LEADER
I20260810 04:15:49.239182 1826 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b2bf04e2d946b8b71c453de6e37c95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42897 } }
I20260810 04:15:49.239586 1828 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4b2bf04e2d946b8b71c453de6e37c95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b2bf04e2d946b8b71c453de6e37c95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42897 } } }
I20260810 04:15:49.239595 1827 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4b2bf04e2d946b8b71c453de6e37c95. Latest consensus state: current_term: 1 leader_uuid: "b4b2bf04e2d946b8b71c453de6e37c95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b2bf04e2d946b8b71c453de6e37c95" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 42897 } } }
I20260810 04:15:49.239777 1828 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:49.239880 1827 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:49.240195 1832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:49.240375 1820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:49.238626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52937 (local address 127.10.249.190:42897)
0810 04:15:49.238687 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:49.238706 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:49.238865 (+ 159us) server_negotiation.cc:407] Connection header received
0810 04:15:49.238887 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:49.238887 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:49.238893 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:49.238940 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:49.239535 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:49.239536 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:49.239536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:49.239541 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:49.239557 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:49.239562 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:49.239620 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:49.239827 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 04:15:49.239841 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:15:49.240768 1832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:49.242375 1832 catalog_manager.cc:1347] Generated new cluster ID: bfa2cf8664f740d8b2e5dfeb0c2f7a46
I20260810 04:15:49.242424 1832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:49.253607 1832 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:49.253750 1832 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:49.266934 1832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4b2bf04e2d946b8b71c453de6e37c95: Generated new TSK 0
I20260810 04:15:49.267097 1832 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:49.273994 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1745
2026-08-10T04:15:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1322 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:49 dist-test-slave-0kls krb5kdc[1848](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:49 dist-test-slave-0kls krb5kdc[1848](info): set up 2 sockets
Aug 10 04:15:49 dist-test-slave-0kls krb5kdc[1848](info): commencing operation
krb5kdc: starting...
W20260810 04:15:50.332587 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:50 dist-test-slave-0kls krb5kdc[1848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335350, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:50.453413 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38575
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:42427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:38575
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:50.536886 1861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:50.537087 1861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:50.537110 1861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:50.538208 1861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:50.538244 1861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:50.538259 1861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:50.538271 1861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:50.538283 1861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:50.539685 1861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:42427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:38575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:38575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:50.539898 1861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:50.540064 1861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:50.544920 1868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:50.544920 1871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:50.545095 1869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:50.545197 1861 server_base.cc:1034] running on GCE node
I20260810 04:15:50.545524 1861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:50.545907 1861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:50.547060 1861 hybrid_clock.cc:648] HybridClock initialized: now 1786335350547047 us; error 28 us; skew 500 ppm
Aug 10 04:15:50 dist-test-slave-0kls krb5kdc[1848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:50.549615 1861 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:50.550060 1861 webserver.cc:460] Webserver started at http://127.10.249.190:36767/ using document root <none> and password file <none>
I20260810 04:15:50.550263 1861 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:50.550305 1861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:50.550392 1861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:50.551364 1861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "90e32c9cd5184627a2cef9f3147759c1"
format_stamp: "Formatted at 2026-08-10 04:15:50 on dist-test-slave-0kls"
server_key: "5d847032291de05d9cb725c96d6d2628"
server_key_iv: "947088986d68f3d4d239401537448771"
server_key_version: "encryptionkey@0"
I20260810 04:15:50.551672 1861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "90e32c9cd5184627a2cef9f3147759c1"
format_stamp: "Formatted at 2026-08-10 04:15:50 on dist-test-slave-0kls"
server_key: "5d847032291de05d9cb725c96d6d2628"
server_key_iv: "947088986d68f3d4d239401537448771"
server_key_version: "encryptionkey@0"
I20260810 04:15:50.552954 1861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:50.553658 1878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:50.553885 1861 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:50.553992 1861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "90e32c9cd5184627a2cef9f3147759c1"
format_stamp: "Formatted at 2026-08-10 04:15:50 on dist-test-slave-0kls"
server_key: "5d847032291de05d9cb725c96d6d2628"
server_key_iv: "947088986d68f3d4d239401537448771"
server_key_version: "encryptionkey@0"
I20260810 04:15:50.554090 1861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:50.562438 1861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:50.564267 1861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:50.564421 1861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:50.568388 1861 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:38575
I20260810 04:15:50.568420 1930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:38575 every 8 connection(s)
I20260810 04:15:50.568747 1861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:50.569621 1931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:50.571846 1931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1: Bootstrap starting.
I20260810 04:15:50.572357 1931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:50.572587 1931 log.cc:824] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:50.573220 1931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1: No bootstrap required, opened a new log
I20260810 04:15:50.574971 1931 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90e32c9cd5184627a2cef9f3147759c1" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38575 } }
I20260810 04:15:50.575112 1931 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:50.575135 1931 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90e32c9cd5184627a2cef9f3147759c1, State: Initialized, Role: FOLLOWER
I20260810 04:15:50.575271 1931 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90e32c9cd5184627a2cef9f3147759c1" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38575 } }
I20260810 04:15:50.575348 1931 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:50.575372 1931 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:50.575399 1931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:50.576156 1931 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90e32c9cd5184627a2cef9f3147759c1" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38575 } }
I20260810 04:15:50.576261 1931 leader_election.cc:302] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90e32c9cd5184627a2cef9f3147759c1; no voters:
I20260810 04:15:50.576411 1931 leader_election.cc:288] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:50.576434 1934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:50.576555 1934 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [term 1 LEADER]: Becoming Leader. State: Replica: 90e32c9cd5184627a2cef9f3147759c1, State: Running, Role: LEADER
I20260810 04:15:50.576683 1931 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:50.576727 1934 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90e32c9cd5184627a2cef9f3147759c1" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38575 } }
I20260810 04:15:50.577147 1935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90e32c9cd5184627a2cef9f3147759c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90e32c9cd5184627a2cef9f3147759c1" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38575 } } }
I20260810 04:15:50.577381 1935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:50.577307 1936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90e32c9cd5184627a2cef9f3147759c1. Latest consensus state: current_term: 1 leader_uuid: "90e32c9cd5184627a2cef9f3147759c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90e32c9cd5184627a2cef9f3147759c1" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 38575 } } }
I20260810 04:15:50.577574 1936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:50.577915 1945 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:50.578493 1945 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:50.578837 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1861
I20260810 04:15:50.578941 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:50.579145 11238 external_mini_cluster.cc:1428] Setting key 77ae5a180337ca77b69d0fe347470c02
I20260810 04:15:50.580137 1945 catalog_manager.cc:1347] Generated new cluster ID: 8f9791f9dd7e4089b484d40d69f78d68
I20260810 04:15:50.580204 1945 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:15:50 dist-test-slave-0kls krb5kdc[1848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335350, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:50.590852 1955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:50.579583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44361 (local address 127.10.249.190:38575)
0810 04:15:50.579911 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:50.579919 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:50.579943 (+ 24us) server_negotiation.cc:407] Connection header received
0810 04:15:50.580029 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:50.580034 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:50.580109 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:50.580978 (+ 869us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:50.581065 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:50.582456 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:50.583529 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:50.584144 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:50.584244 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:50.587197 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:50.587202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:50.587202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:50.587214 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:50.589200 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:50.589599 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:50.589602 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:50.589603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:50.589709 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:50.589937 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:50.589938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:50.589938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:50.590237 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:50.590396 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:50.590464 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 04:15:50.590611 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":81,"threads_started":1}
I20260810 04:15:50.592056 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:50.600473 1955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:50.593425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56577 (local address 127.10.249.190:38575)
0810 04:15:50.593458 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:50.593460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:50.593739 (+ 279us) server_negotiation.cc:407] Connection header received
0810 04:15:50.593766 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:50.593767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:50.593777 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:50.593862 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:50.594403 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:50.595152 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:50.596099 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:50.596419 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:50.596488 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:50.597780 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:50.597802 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:50.597803 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:50.597810 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:50.599346 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:50.599713 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:50.599714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:50.599714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:50.599785 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:50.599978 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:50.599979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:50.599980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:50.600105 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:50.600216 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:50.600309 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 04:15:50.600386 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:15:50.608089 1945 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:50.608785 1945 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:50.611807 1945 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90e32c9cd5184627a2cef9f3147759c1: Generated new TSK 0
I20260810 04:15:50.611981 1945 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:50.615196 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1861
2026-08-10T04:15:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1342 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:50 dist-test-slave-0kls krb5kdc[1964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:50 dist-test-slave-0kls krb5kdc[1964](info): set up 2 sockets
Aug 10 04:15:50 dist-test-slave-0kls krb5kdc[1964](info): commencing operation
krb5kdc: starting...
W20260810 04:15:51.676416 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:51 dist-test-slave-0kls krb5kdc[1964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:51.801095 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:36749
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:43217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:36749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:51.888129 1977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:51.888374 1977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:51.888409 1977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:51.889531 1977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:51.889612 1977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:51.889634 1977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:51.889655 1977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:51.889685 1977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:51.891208 1977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:43217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:36749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:36749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:51.891502 1977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:51.891736 1977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:51.896790 1986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:51.896781 1983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:51.897064 1977 server_base.cc:1034] running on GCE node
W20260810 04:15:51.896924 1982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:51.897380 1977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:51.897673 1977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:51.898844 1977 hybrid_clock.cc:648] HybridClock initialized: now 1786335351898848 us; error 48 us; skew 500 ppm
Aug 10 04:15:51 dist-test-slave-0kls krb5kdc[1964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335351, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:51.901361 1977 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:51.901891 1977 webserver.cc:460] Webserver started at http://127.10.249.190:38819/ using document root <none> and password file <none>
I20260810 04:15:51.902143 1977 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:51.902189 1977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:51.902361 1977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:51.903358 1977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "21bceffc297e4b27aeff159cffc1abc0"
format_stamp: "Formatted at 2026-08-10 04:15:51 on dist-test-slave-0kls"
server_key: "9e04991b7dd0cb3d35d11679db09d2bd"
server_key_iv: "1980c3db5dc8e8f5b7cbb2135f9ea842"
server_key_version: "encryptionkey@0"
I20260810 04:15:51.903721 1977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "21bceffc297e4b27aeff159cffc1abc0"
format_stamp: "Formatted at 2026-08-10 04:15:51 on dist-test-slave-0kls"
server_key: "9e04991b7dd0cb3d35d11679db09d2bd"
server_key_iv: "1980c3db5dc8e8f5b7cbb2135f9ea842"
server_key_version: "encryptionkey@0"
I20260810 04:15:51.905134 1977 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:51.905961 1994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:51.906169 1977 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:51.906284 1977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "21bceffc297e4b27aeff159cffc1abc0"
format_stamp: "Formatted at 2026-08-10 04:15:51 on dist-test-slave-0kls"
server_key: "9e04991b7dd0cb3d35d11679db09d2bd"
server_key_iv: "1980c3db5dc8e8f5b7cbb2135f9ea842"
server_key_version: "encryptionkey@0"
I20260810 04:15:51.906375 1977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:51.922232 1977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:51.923919 1977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:51.924084 1977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:51.928179 1977 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:36749
I20260810 04:15:51.928225 2048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:36749 every 8 connection(s)
I20260810 04:15:51.928575 1977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:51.929445 2049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:51.931756 2049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0: Bootstrap starting.
I20260810 04:15:51.932343 2049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:51.932624 2049 log.cc:824] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:51.933346 2049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0: No bootstrap required, opened a new log
I20260810 04:15:51.934968 2049 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21bceffc297e4b27aeff159cffc1abc0" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36749 } }
I20260810 04:15:51.935101 2049 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:51.935122 2049 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21bceffc297e4b27aeff159cffc1abc0, State: Initialized, Role: FOLLOWER
I20260810 04:15:51.935322 2049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21bceffc297e4b27aeff159cffc1abc0" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36749 } }
I20260810 04:15:51.935407 2049 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:51.935462 2049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:51.935509 2049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:51.936290 2049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21bceffc297e4b27aeff159cffc1abc0" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36749 } }
I20260810 04:15:51.936395 2049 leader_election.cc:302] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21bceffc297e4b27aeff159cffc1abc0; no voters:
I20260810 04:15:51.936579 2049 leader_election.cc:288] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:51.936620 2052 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:51.936812 2052 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [term 1 LEADER]: Becoming Leader. State: Replica: 21bceffc297e4b27aeff159cffc1abc0, State: Running, Role: LEADER
I20260810 04:15:51.936856 2049 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:51.936942 2052 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21bceffc297e4b27aeff159cffc1abc0" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36749 } }
I20260810 04:15:51.937429 2054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21bceffc297e4b27aeff159cffc1abc0. Latest consensus state: current_term: 1 leader_uuid: "21bceffc297e4b27aeff159cffc1abc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21bceffc297e4b27aeff159cffc1abc0" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36749 } } }
I20260810 04:15:51.937518 2054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:51.937772 2061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:51.937410 2053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21bceffc297e4b27aeff159cffc1abc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21bceffc297e4b27aeff159cffc1abc0" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 36749 } } }
I20260810 04:15:51.938056 2053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:51.938352 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 1977
I20260810 04:15:51.938374 2061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:51.938483 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:51.938747 11238 external_mini_cluster.cc:1428] Setting key b42eb33157fae1171ffb3c53f123f897
I20260810 04:15:51.940097 2061 catalog_manager.cc:1347] Generated new cluster ID: 43bceac7a6c040f1894a47d9b3b78672
I20260810 04:15:51.940156 2061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:51.951834 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:51.939242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58561 (local address 127.10.249.190:36749)
0810 04:15:51.939407 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:51.939418 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:51.946118 (+ 6700us) server_negotiation.cc:407] Connection header received
0810 04:15:51.946285 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:51.946293 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:51.946357 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:51.946522 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:51.946786 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:51.948189 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:51.949369 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:51.950036 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:51.950137 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:51.950938 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:51.950942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:51.950943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:51.951169 (+ 226us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:51.951208 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:51.951223 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:51.951282 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:51.951405 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 04:15:51.951594 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":84,"threads_started":1}
I20260810 04:15:51.952854 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:51.960274 2061 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:51.960995 2061 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:51.961755 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:51.954475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40603 (local address 127.10.249.190:36749)
0810 04:15:51.954566 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:51.954568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:51.958049 (+ 3481us) server_negotiation.cc:407] Connection header received
0810 04:15:51.958112 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:51.958112 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:51.958125 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:51.958185 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:51.958322 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:51.959298 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:51.960393 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:51.960694 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:51.960763 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:51.961475 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:51.961477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:51.961478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:51.961483 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:51.961501 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:51.961506 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:51.961567 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:51.961635 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 04:15:51.961677 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":224,"server-negotiator.queue_time_us":56}
I20260810 04:15:51.968791 2061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21bceffc297e4b27aeff159cffc1abc0: Generated new TSK 0
I20260810 04:15:51.969017 2061 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:51.971910 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 1977
2026-08-10T04:15:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1355 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:52 dist-test-slave-0kls krb5kdc[2080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:52 dist-test-slave-0kls krb5kdc[2080](info): set up 2 sockets
Aug 10 04:15:52 dist-test-slave-0kls krb5kdc[2080](info): commencing operation
krb5kdc: starting...
W20260810 04:15:52.992713 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.001s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:53 dist-test-slave-0kls krb5kdc[2080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:53.114264 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43543
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:43543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:53.191766 2094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:53.191998 2094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:53.192021 2094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:53.193137 2094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:53.193178 2094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:53.193192 2094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:53.193205 2094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:53.193256 2094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:53.194782 2094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:43543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:43543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:53.194967 2094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:53.195225 2094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:53.200249 2100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:53.200273 2099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:53.200256 2102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:53.200685 2094 server_base.cc:1034] running on GCE node
I20260810 04:15:53.200953 2094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:53.201247 2094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:53.202409 2094 hybrid_clock.cc:648] HybridClock initialized: now 1786335353202396 us; error 30 us; skew 500 ppm
Aug 10 04:15:53 dist-test-slave-0kls krb5kdc[2080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335353, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:53.204953 2094 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:53.205473 2094 webserver.cc:460] Webserver started at http://127.10.249.190:35455/ using document root <none> and password file <none>
I20260810 04:15:53.205705 2094 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:53.205773 2094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:53.205953 2094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:53.207047 2094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "5924774697ff4a94b74310a4875fa901"
format_stamp: "Formatted at 2026-08-10 04:15:53 on dist-test-slave-0kls"
server_key: "383d46224de317e1bef024073aebd7c7"
server_key_iv: "b1595b9889ecceed5637b966d5f6836b"
server_key_version: "encryptionkey@0"
I20260810 04:15:53.207401 2094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "5924774697ff4a94b74310a4875fa901"
format_stamp: "Formatted at 2026-08-10 04:15:53 on dist-test-slave-0kls"
server_key: "383d46224de317e1bef024073aebd7c7"
server_key_iv: "b1595b9889ecceed5637b966d5f6836b"
server_key_version: "encryptionkey@0"
I20260810 04:15:53.208729 2094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:53.209579 2110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:53.209862 2094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:53.209964 2094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "5924774697ff4a94b74310a4875fa901"
format_stamp: "Formatted at 2026-08-10 04:15:53 on dist-test-slave-0kls"
server_key: "383d46224de317e1bef024073aebd7c7"
server_key_iv: "b1595b9889ecceed5637b966d5f6836b"
server_key_version: "encryptionkey@0"
I20260810 04:15:53.210060 2094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:53.213346 2094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:53.215358 2094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:53.215512 2094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:53.219230 2094 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:43543
I20260810 04:15:53.219322 2165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:43543 every 8 connection(s)
I20260810 04:15:53.219616 2094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:53.220652 2166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:53.223019 2166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901: Bootstrap starting.
I20260810 04:15:53.223600 2166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:53.223899 2166 log.cc:824] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:53.224561 2166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901: No bootstrap required, opened a new log
I20260810 04:15:53.226182 2166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5924774697ff4a94b74310a4875fa901" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43543 } }
I20260810 04:15:53.226327 2166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:15:53.226372 2166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5924774697ff4a94b74310a4875fa901, State: Initialized, Role: FOLLOWER
I20260810 04:15:53.226496 2166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5924774697ff4a94b74310a4875fa901" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43543 } }
I20260810 04:15:53.226594 2166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:15:53.226634 2166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:15:53.226687 2166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:53.227470 2166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5924774697ff4a94b74310a4875fa901" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43543 } }
I20260810 04:15:53.227591 2166 leader_election.cc:302] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5924774697ff4a94b74310a4875fa901; no voters:
I20260810 04:15:53.227785 2166 leader_election.cc:288] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:15:53.227828 2169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:53.227996 2169 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [term 1 LEADER]: Becoming Leader. State: Replica: 5924774697ff4a94b74310a4875fa901, State: Running, Role: LEADER
I20260810 04:15:53.228046 2166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:53.228168 2169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5924774697ff4a94b74310a4875fa901" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43543 } }
I20260810 04:15:53.228541 2170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5924774697ff4a94b74310a4875fa901" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5924774697ff4a94b74310a4875fa901" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43543 } } }
I20260810 04:15:53.228638 2170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:53.228549 2171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5924774697ff4a94b74310a4875fa901. Latest consensus state: current_term: 1 leader_uuid: "5924774697ff4a94b74310a4875fa901" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5924774697ff4a94b74310a4875fa901" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 43543 } } }
I20260810 04:15:53.228715 2171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:53.228965 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 2094
I20260810 04:15:53.229110 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:53.229296 11238 external_mini_cluster.cc:1428] Setting key 12176c0867c93dcb94da0e2d10c1fded
I20260810 04:15:53.229707 2178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:53.230187 2178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:53.231767 2178 catalog_manager.cc:1347] Generated new cluster ID: 3f07c8023a1e468dbd92171b6f90ec23
I20260810 04:15:53.231819 2178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:53.232246 2183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:53.229987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39521 (local address 127.10.249.190:43543)
0810 04:15:53.230594 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:53.230608 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:53.230632 (+ 24us) server_negotiation.cc:407] Connection header received
0810 04:15:53.230808 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:53.230816 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:53.230848 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:53.231261 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:53.231733 (+ 472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:53.231737 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:53.231737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:53.231741 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:53.231776 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:53.231788 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:53.232015 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:53.232043 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 04:15:53.232083 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":83,"threads_started":1}
I20260810 04:15:53.233192 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:53.235641 2183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:53.234739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37531 (local address 127.10.249.190:43543)
0810 04:15:53.234788 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:53.234789 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:53.234848 (+ 59us) server_negotiation.cc:407] Connection header received
0810 04:15:53.234896 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:53.234897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:53.234900 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:53.234963 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:53.235452 (+ 489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:53.235453 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:53.235454 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:15:53.235458 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:53.235472 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:15:53.235476 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:53.235534 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:53.235580 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 04:15:53.235591 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:15:53.241732 2178 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:53.241889 2178 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:53.244124 2178 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5924774697ff4a94b74310a4875fa901: Generated new TSK 0
I20260810 04:15:53.244298 2178 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:53.247757 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 2094
2026-08-10T04:15:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1276 ms)
[----------] 18 tests from AuthTokenIssuingTest (23454 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:53 dist-test-slave-0kls krb5kdc[2197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:53 dist-test-slave-0kls krb5kdc[2197](info): set up 2 sockets
Aug 10 04:15:53 dist-test-slave-0kls krb5kdc[2197](info): commencing operation
krb5kdc: starting...
W20260810 04:15:54.312269 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:54.430274 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:40521
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:40521,127.10.249.189:40837,127.10.249.188:44081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:54.506902 2210 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:15:54.507089 2210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:54.507107 2210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:54.507126 2210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:54.508159 2210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:54.508198 2210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:54.508211 2210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:54.508224 2210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:54.508235 2210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:54.509642 2210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:40521,127.10.249.189:40837,127.10.249.188:44081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:40521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:54.509877 2210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:54.510054 2210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:54.514655 2216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:54.514814 2210 server_base.cc:1034] running on GCE node
W20260810 04:15:54.514673 2215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:54.514655 2219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:54.515110 2210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:54.515391 2210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:54.516542 2210 hybrid_clock.cc:648] HybridClock initialized: now 1786335354516530 us; error 27 us; skew 500 ppm
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:54.522624 2210 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:54.523092 2210 webserver.cc:460] Webserver started at http://127.10.249.190:38545/ using document root <none> and password file <none>
I20260810 04:15:54.523341 2210 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:54.523406 2210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:54.523553 2210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:54.524566 2210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "8163273395e7423e85481acbf0d4cdc2"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "678eb797f923c5fd638ec28ce236ff62"
server_key_iv: "89302467dc9e415654269297527555dc"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.524911 2210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "8163273395e7423e85481acbf0d4cdc2"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "678eb797f923c5fd638ec28ce236ff62"
server_key_iv: "89302467dc9e415654269297527555dc"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.526216 2210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:15:54.526901 2226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:54.527065 2210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:54.527168 2210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "8163273395e7423e85481acbf0d4cdc2"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "678eb797f923c5fd638ec28ce236ff62"
server_key_iv: "89302467dc9e415654269297527555dc"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.527247 2210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:54.537919 2210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:54.539618 2210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:54.539826 2210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:54.543931 2210 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:40521
I20260810 04:15:54.543958 2281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:40521 every 8 connection(s)
I20260810 04:15:54.544274 2210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:54.544559 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 2210
I20260810 04:15:54.544677 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:54.544814 11238 external_mini_cluster.cc:1428] Setting key 4da49dbdd309efd749a4e8a6c81cd548
I20260810 04:15:54.545136 2282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:54.546538 2282 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.249.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.189@KRBTEST.COM" created.
I20260810 04:15:54.556449 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.547289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48704 (local address 127.10.249.190:40521)
0810 04:15:54.547421 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.547425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.547460 (+ 35us) server_negotiation.cc:407] Connection header received
0810 04:15:54.547886 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.547889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.547909 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.548003 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.548527 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.549875 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.550704 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.551199 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.551319 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.553220 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.553229 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.553229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.553236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.554835 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.555213 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.555215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.555215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.555292 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.555575 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.555577 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.555577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.555880 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.555980 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.556206 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.556307 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260810 04:15:54.556602 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.547112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:40521 (local address 127.0.0.1:48704)
0810 04:15:54.547266 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.547303 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.547739 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.548017 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.548020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.548251 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.548397 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.548400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.549963 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.549963 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.550616 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.550618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.551289 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.551289 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.551343 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.551842 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.551849 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.553138 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.554916 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.554923 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.554925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.555132 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.555371 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.555372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.555372 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.555480 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.555972 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.555980 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.556057 (+ 77us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.556158 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.556412 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":83,"thread_start_us":77,"threads_started":1}
I20260810 04:15:54.557395 2282 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:15:54.557732 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.557615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58374)
0810 04:15:54.557664 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.557705 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 04:15:54.557912 2228 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
I20260810 04:15:54.558367 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.558280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58378)
0810 04:15:54.558326 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.558351 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:15:54.558487 2282 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:40837: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab.
Entry for principal kudu/127.10.249.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab.
I20260810 04:15:54.570822 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.189:40837
--webserver_interface=127.10.249.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab
--principal=kudu/127.10.249.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:40521,127.10.249.189:40837,127.10.249.188:44081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:15:54.607694 2282 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } attempt: 1
I20260810 04:15:54.608142 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.608015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58382)
0810 04:15:54.608079 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.608116 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 04:15:54.608569 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.608411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58390)
0810 04:15:54.608474 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.608536 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 04:15:54.608701 2282 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:40837: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
W20260810 04:15:54.651209 2289 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:15:54.651401 2289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:54.651419 2289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:54.651486 2289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:54.652629 2289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:54.652670 2289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:54.652684 2289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:54.652738 2289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:54.652765 2289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:54.654215 2289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:40521,127.10.249.189:40837,127.10.249.188:44081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab
--principal=kudu/127.10.249.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.189:40837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.249.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:54.654458 2289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:54.654707 2289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:54.659446 2298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:54.659466 2295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:54.659461 2296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:54.660105 2289 server_base.cc:1034] running on GCE node
I20260810 04:15:54.660343 2289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:54.660614 2289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:54.661872 2289 hybrid_clock.cc:648] HybridClock initialized: now 1786335354661847 us; error 24 us; skew 500 ppm
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:54.664271 2289 init.cc:377] Logged in from keytab as kudu/127.10.249.189@KRBTEST.COM (short username kudu)
I20260810 04:15:54.664767 2289 webserver.cc:460] Webserver started at http://127.10.249.189:45075/ using document root <none> and password file <none>
I20260810 04:15:54.664989 2289 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:54.665055 2289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:54.665210 2289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:54.666357 2289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/data/instance:
uuid: "dee9aee2cdc644e88fc882bde57db89c"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "af6d14c82037ccef848af7b5be1ead56"
server_key_iv: "91ee9ac2587c08557e319fabbcd3215f"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.666733 2289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/wal/instance:
uuid: "dee9aee2cdc644e88fc882bde57db89c"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "af6d14c82037ccef848af7b5be1ead56"
server_key_iv: "91ee9ac2587c08557e319fabbcd3215f"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.668098 2289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:54.668848 2305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:54.669154 2289 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:54.669282 2289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/wal
uuid: "dee9aee2cdc644e88fc882bde57db89c"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "af6d14c82037ccef848af7b5be1ead56"
server_key_iv: "91ee9ac2587c08557e319fabbcd3215f"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.669368 2289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:54.676846 2282 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } attempt: 2
I20260810 04:15:54.677241 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.677107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58398)
0810 04:15:54.677167 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.677205 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 04:15:54.677580 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.677502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58410)
0810 04:15:54.677540 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.677563 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 04:15:54.677680 2282 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:40837: Network error: Client connection negotiation failed: client connection to 127.10.249.189:40837: connect: Connection refused (error 111)
I20260810 04:15:54.680540 2289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:54.682498 2289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:54.682644 2289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:54.686659 2289 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.189:40837
I20260810 04:15:54.686688 2359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.189:40837 every 8 connection(s)
I20260810 04:15:54.687005 2289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
I20260810 04:15:54.687845 2360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:54.689169 2360 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:54.695138 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 2289
I20260810 04:15:54.695276 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-1/wal/instance
I20260810 04:15:54.695490 11238 external_mini_cluster.cc:1428] Setting key 85473ee20a1de6c5aea0dd9f9434877c
I20260810 04:15:54.697839 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.689757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48716 (local address 127.10.249.190:40521)
0810 04:15:54.689857 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.689859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.690021 (+ 162us) server_negotiation.cc:407] Connection header received
0810 04:15:54.690554 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.690555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.690569 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.690635 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.691234 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.691716 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.692670 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.692874 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.692957 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.694881 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.694883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.694883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.694889 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.696542 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.696901 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.696902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.696903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.696961 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.697207 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.697209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.697209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.697323 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.697391 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.697648 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.697737 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 04:15:54.697989 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.689737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:40521 (local address 127.0.0.1:48716)
0810 04:15:54.689905 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.689947 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.690428 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.690709 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.690716 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.690946 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.691122 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.691126 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.691809 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.691810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.692565 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.692567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.692979 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.692980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.693091 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.693477 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.693484 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.694794 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.696634 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.696640 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.696642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.696836 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.697029 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.697030 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.697030 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.697119 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.697394 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.697401 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.697517 (+ 116us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.697611 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.697753 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260810 04:15:54.698513 2360 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.249.188@KRBTEST.COM; defaulting to no policy
I20260810 04:15:54.705724 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.698747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58422)
0810 04:15:54.698802 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.698811 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.698841 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.699097 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.699098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.699250 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.699307 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.699308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.700082 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.700084 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.700989 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.700992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.701437 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.701438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.701522 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.701958 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.701963 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.703084 (+ 1121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.704734 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.704735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.704736 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.704898 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.705113 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.705114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.705114 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.705180 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.705443 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.705444 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.705478 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.705537 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.705624 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 04:15:54.705809 2364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.698804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58422 (local address 127.10.249.189:40837)
0810 04:15:54.698946 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.698950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.698966 (+ 16us) server_negotiation.cc:407] Connection header received
0810 04:15:54.698991 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.698992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.699001 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.699074 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.699374 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.700002 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.701076 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.701361 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.701411 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.703163 (+ 1752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.703171 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.703172 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.703185 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.704644 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.704990 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.704992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.704993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.705048 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.705244 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.705245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.705245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.705377 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.705464 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.705561 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.705672 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":105,"thread_start_us":82,"threads_started":1}
I20260810 04:15:54.706350 2360 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.188@KRBTEST.COM" created.
I20260810 04:15:54.706624 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.706542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33606)
0810 04:15:54.706572 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.706608 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260810 04:15:54.706774 2309 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
I20260810 04:15:54.708244 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.708120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33622)
0810 04:15:54.708175 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.708206 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 04:15:54.708374 2360 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:44081: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab.
Entry for principal kudu/127.10.249.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab.
I20260810 04:15:54.720765 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.188:44081
--webserver_interface=127.10.249.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab
--principal=kudu/127.10.249.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:45517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:40521,127.10.249.189:40837,127.10.249.188:44081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:15:54.757615 2360 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } attempt: 1
I20260810 04:15:54.758149 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.757987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33638)
0810 04:15:54.758070 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.758114 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 04:15:54.758569 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.758474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33654)
0810 04:15:54.758519 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.758547 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 04:15:54.758667 2360 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:44081: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
I20260810 04:15:54.768821 2282 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } attempt: 3
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
I20260810 04:15:54.775882 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.769206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58434)
0810 04:15:54.769247 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.769258 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.769325 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.769475 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.769476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.769626 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.769695 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.769696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.770388 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.770390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.770948 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.770950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.771345 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.771347 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.771430 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.771917 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.771922 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.773220 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.774892 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.774893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.774893 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.775048 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.775247 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.775248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.775248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.775308 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.775541 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.775542 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.775586 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.775696 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.775790 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260810 04:15:54.775880 2364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.769270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.10.249.189:40837)
0810 04:15:54.769335 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.769337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.769349 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:15:54.769404 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.769405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.769413 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.769459 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.769777 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.770301 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.771046 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.771270 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.771346 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.773309 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.773310 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.773311 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.773318 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.774771 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.775118 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.775119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.775120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.775178 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.775371 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.775372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.775372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.775476 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.775548 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.775733 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.775803 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:15:54.776314 2282 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:15:54.776639 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.776544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33666)
0810 04:15:54.776592 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.776620 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 04:15:54.776970 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.776867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33682)
0810 04:15:54.776927 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.776950 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 04:15:54.777061 2282 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:44081: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
W20260810 04:15:54.799412 2367 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:15:54.799584 2367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:54.799600 2367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:54.799643 2367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:54.800755 2367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:54.800792 2367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:54.800807 2367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:54.800859 2367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:54.800881 2367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:54.802289 2367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:45517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:40521,127.10.249.189:40837,127.10.249.188:44081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab
--principal=kudu/127.10.249.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.188:44081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.249.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:54.802515 2367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:54.802747 2367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:54.807271 2375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:54.807307 2373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:54.807446 2367 server_base.cc:1034] running on GCE node
W20260810 04:15:54.807520 2372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:54.807751 2367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:54.808030 2367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:54.808223 2282 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } attempt: 1
I20260810 04:15:54.808559 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.808446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33696)
0810 04:15:54.808499 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.808525 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 04:15:54.808832 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.808750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33712)
0810 04:15:54.808791 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.808813 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 04:15:54.808923 2282 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:44081: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
I20260810 04:15:54.809170 2367 hybrid_clock.cc:648] HybridClock initialized: now 1786335354809156 us; error 32 us; skew 500 ppm
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:54.811434 2367 init.cc:377] Logged in from keytab as kudu/127.10.249.188@KRBTEST.COM (short username kudu)
I20260810 04:15:54.811805 2367 webserver.cc:460] Webserver started at http://127.10.249.188:43597/ using document root <none> and password file <none>
I20260810 04:15:54.811959 2367 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:54.811995 2367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:54.812071 2367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:54.812938 2367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/data/instance:
uuid: "c353e11598694fc9932d535605252f9e"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "2bc70a1a0009facb217fff1465fbe02d"
server_key_iv: "050150ed07c4db7a44e2833061f4d110"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.813206 2367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/wal/instance:
uuid: "c353e11598694fc9932d535605252f9e"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "2bc70a1a0009facb217fff1465fbe02d"
server_key_iv: "050150ed07c4db7a44e2833061f4d110"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.814393 2367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:15:54.814992 2383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:54.815153 2367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:15:54.815253 2367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/wal
uuid: "c353e11598694fc9932d535605252f9e"
format_stamp: "Formatted at 2026-08-10 04:15:54 on dist-test-slave-0kls"
server_key: "2bc70a1a0009facb217fff1465fbe02d"
server_key_iv: "050150ed07c4db7a44e2833061f4d110"
server_key_version: "encryptionkey@0"
I20260810 04:15:54.815322 2367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:54.826789 2360 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } attempt: 2
I20260810 04:15:54.827129 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.827006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33716)
0810 04:15:54.827074 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.827107 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 04:15:54.827445 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.827360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33722)
0810 04:15:54.827400 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.827423 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 04:15:54.827538 2360 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:44081: Network error: Client connection negotiation failed: client connection to 127.10.249.188:44081: connect: Connection refused (error 111)
I20260810 04:15:54.839219 2367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:54.840983 2367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:54.841145 2367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:54.844833 2367 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.188:44081
I20260810 04:15:54.844868 2438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.188:44081 every 8 connection(s)
I20260810 04:15:54.845201 2367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
I20260810 04:15:54.845978 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 2367
I20260810 04:15:54.846097 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786335069075394-11238-0/minicluster-data/master-2/wal/instance
I20260810 04:15:54.846208 2439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:54.846305 11238 external_mini_cluster.cc:1428] Setting key 01ed20302a23d0e10b55d53e4fd1ca07
I20260810 04:15:54.848518 2439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:54.857054 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.849408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48726 (local address 127.10.249.190:40521)
0810 04:15:54.849483 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.849485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.849654 (+ 169us) server_negotiation.cc:407] Connection header received
0810 04:15:54.849747 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.849748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.849761 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.849858 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.850274 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.850899 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.851783 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.851967 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.852051 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.854435 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.854437 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.854437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.854445 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.855805 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.856209 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.856210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.856210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.856287 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.856470 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.856471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.856471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.856594 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.856652 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.856897 (+ 245us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.856970 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 04:15:54.857190 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.846787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33726 (local address 127.10.249.188:44081)
0810 04:15:54.846964 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.846978 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.847002 (+ 24us) server_negotiation.cc:407] Connection header received
0810 04:15:54.847632 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.847640 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.847697 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.847806 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.848584 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.849722 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.850708 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.851190 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.851296 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.853762 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.853768 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.853768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.853774 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.855567 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.855928 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.855931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.855931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.856028 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.856249 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.856250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.856251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.856535 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.856689 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.856815 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.856976 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":102,"threads_started":1}
I20260810 04:15:54.857455 2443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.849353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:40521 (local address 127.0.0.1:48726)
0810 04:15:54.849538 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.849583 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.849673 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.849877 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.849880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.850112 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.850182 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.850184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.850992 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.850993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.851694 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.851696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.852064 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.852065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.852141 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.852606 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.852614 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.854352 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.855879 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.855886 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.855889 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.856132 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.856354 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.856355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.856355 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.856409 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.856678 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.856685 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.856753 (+ 68us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.856848 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.857369 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":383,"thread_start_us":97,"threads_started":1}
I20260810 04:15:54.858038 2439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:54.865578 2443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.858279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:40837 (local address 127.0.0.1:58448)
0810 04:15:54.858416 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.858426 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.858489 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.858624 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.858625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.858789 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.858843 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.858844 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.859649 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.859650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.860409 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.860411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.860921 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.860922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.860992 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.861457 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.861463 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.862753 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.864516 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.864517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.864517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.864749 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.864939 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.864940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.864940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.865059 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.865318 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.865319 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.865364 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.865438 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.865505 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122}
I20260810 04:15:54.865679 2364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.858338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58448 (local address 127.10.249.189:40837)
0810 04:15:54.858386 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.858388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.858466 (+ 78us) server_negotiation.cc:407] Connection header received
0810 04:15:54.858567 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.858568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.858576 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.858617 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.858926 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.859564 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.860531 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.860848 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.860908 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.862840 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.862842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.862842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.862850 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.864423 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.864824 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.864825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.864826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.864876 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.865149 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.865150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.865150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.865251 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.865299 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.865477 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.865549 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:15:54.866042 2439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:15:54.866544 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.858151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48734 (local address 127.10.249.190:40521)
0810 04:15:54.858183 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.858185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.858197 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:15:54.858279 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.858279 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.858288 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.858345 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.858947 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.859563 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.860540 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.860821 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.860892 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.863453 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.863455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.863455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.863462 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.865264 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.865704 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.865705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.865705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.865779 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.866017 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.866018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.866018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.866122 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.866345 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.866385 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.866456 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
I20260810 04:15:54.873318 2443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.866309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33730)
0810 04:15:54.866376 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.866385 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.866429 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.866624 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.866624 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.866792 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.866837 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.866839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.867627 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.867629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.868192 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.868194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.868609 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.868610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.868663 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.868984 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.868989 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.870344 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.872212 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.872212 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.872213 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.872410 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.872665 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.872666 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.872666 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.872726 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.873026 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.873026 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.873062 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.873126 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.873263 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 04:15:54.873441 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.866338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33730 (local address 127.10.249.188:44081)
0810 04:15:54.866373 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.866375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.866415 (+ 40us) server_negotiation.cc:407] Connection header received
0810 04:15:54.866514 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.866515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.866525 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.866571 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.866923 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.867549 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.868267 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.868537 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.868583 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.870424 (+ 1841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.870425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.870426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.870432 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.872134 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.872506 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.872507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.872507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.872562 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.872819 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.872820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.872820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.872941 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.873013 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.873168 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.873342 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":89,"server-negotiator.queue_time_us":16}
I20260810 04:15:54.874645 2364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.867245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58454 (local address 127.10.249.189:40837)
0810 04:15:54.867292 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.867294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.867302 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:15:54.867320 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.867321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.867329 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.867383 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.867902 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.868352 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.869198 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.869366 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.869411 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.871913 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.871914 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.871915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.871922 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.873548 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.873922 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.873923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.873923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.873974 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.874175 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.874176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.874177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.874286 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.874453 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.874488 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.874554 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:15:54.874786 2439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e: Bootstrap starting.
I20260810 04:15:54.875869 2439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:54.876194 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:54.876223 2439 log.cc:824] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:54.877022 2439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e: No bootstrap required, opened a new log
I20260810 04:15:54.877300 2255 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8163273395e7423e85481acbf0d4cdc2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48734
I20260810 04:15:54.878539 2439 raft_consensus.cc:348] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } }
I20260810 04:15:54.878654 2439 raft_consensus.cc:729] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c353e11598694fc9932d535605252f9e, State: Initialized, Role: FOLLOWER
I20260810 04:15:54.878747 2439 consensus_queue.cc:260] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } }
I20260810 04:15:54.879073 2439 sys_catalog.cc:564] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:54.879060 2445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.879165 2445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:15:54.881035 2456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:54.881101 2456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:54.881294 2367 master_runner.cc:186] Error getting master registration for 127.10.249.190:40521: OK, instance_id { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" instance_seqno: 1786335354542725 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:15:54.883323 2367 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:15:54.884047 2282 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } attempt: 2
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
I20260810 04:15:54.890012 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.884374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33734 (local address 127.10.249.188:44081)
0810 04:15:54.884426 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.884427 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.884434 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:15:54.884455 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.884456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.884462 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.884513 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.884765 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.885202 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.885842 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.886025 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.886093 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.887569 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.887570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.887571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.887577 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.888856 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.889210 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.889211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.889212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.889267 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.889465 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.889466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.889466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.889603 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.889683 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.889862 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.889928 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:15:54.890017 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.884251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33734)
0810 04:15:54.884298 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.884308 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.884344 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.884530 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.884530 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.884659 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.884692 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.884693 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.885274 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.885275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.885741 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.885743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.886103 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.886104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.886157 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.886499 (+ 342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.886502 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.887475 (+ 973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.888960 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.888961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.888961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.889124 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.889338 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.889338 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.889339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.889400 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.889680 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.889681 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.889725 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.889835 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.889928 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 04:15:54.891539 2282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2: Bootstrap starting.
I20260810 04:15:54.892216 2282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:54.892485 2282 log.cc:824] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:54.893255 2282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2: No bootstrap required, opened a new log
I20260810 04:15:54.894263 2282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } }
I20260810 04:15:54.894357 2282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8163273395e7423e85481acbf0d4cdc2, State: Initialized, Role: FOLLOWER
I20260810 04:15:54.894445 2282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } }
I20260810 04:15:54.894735 2282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:54.894698 2459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.894788 2255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 04:15:54.894850 2255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:54.895613 2255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } }
I20260810 04:15:54.896502 2255 leader_election.cc:288] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [CANDIDATE]: Term 1 election: Requested vote from peers dee9aee2cdc644e88fc882bde57db89c (127.10.249.189:40837), c353e11598694fc9932d535605252f9e (127.10.249.188:44081)
I20260810 04:15:54.896574 2411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8163273395e7423e85481acbf0d4cdc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c353e11598694fc9932d535605252f9e"
I20260810 04:15:54.896699 2411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:54.894786 2459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:54.897524 2411 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8163273395e7423e85481acbf0d4cdc2 in term 1.
I20260810 04:15:54.898334 2230 leader_election.cc:302] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8163273395e7423e85481acbf0d4cdc2, c353e11598694fc9932d535605252f9e; no voters:
I20260810 04:15:54.898466 2459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:54.898627 2459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [term 1 LEADER]: Becoming Leader. State: Replica: 8163273395e7423e85481acbf0d4cdc2, State: Running, Role: LEADER
I20260810 04:15:54.898716 2459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } }
W20260810 04:15:54.898778 2470 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:54.899025 2470 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:54.899130 2459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8163273395e7423e85481acbf0d4cdc2. Latest consensus state: current_term: 1 leader_uuid: "8163273395e7423e85481acbf0d4cdc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.899220 2459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:54.899931 2210 master_runner.cc:186] Error getting master registration for 127.10.249.189:40837: OK, instance_id { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" instance_seqno: 1786335354685540 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:15:54.902179 2210 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:15:54.906685 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.897652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48738 (local address 127.10.249.190:40521)
0810 04:15:54.897746 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.897749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.898063 (+ 314us) server_negotiation.cc:407] Connection header received
0810 04:15:54.898154 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.898154 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.898165 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.898234 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.898958 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.899622 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.900627 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.900929 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.900992 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.903428 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.903429 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.903430 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.903437 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.905216 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.905573 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.905573 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.905574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.905623 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.906112 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.906113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.906114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.906229 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.906312 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.906518 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.906588 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 04:15:54.907269 2481 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:54.907487 2481 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:54.910115 2411 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [term 1 FOLLOWER]: Refusing update from remote peer 8163273395e7423e85481acbf0d4cdc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:54.910544 2459 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:54.910936 2364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.897706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58456 (local address 127.10.249.189:40837)
0810 04:15:54.897778 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.897794 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.898228 (+ 434us) server_negotiation.cc:407] Connection header received
0810 04:15:54.900731 (+ 2503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.900732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.900741 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.900769 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.901738 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.902389 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.904372 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.905146 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.905199 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.907872 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.907873 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.907874 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.907880 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.909296 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.909854 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.909855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.909855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.909925 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.910212 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.910213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.910214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.910366 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.910436 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.910761 (+ 325us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.910846 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 04:15:54.911936 2445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8163273395e7423e85481acbf0d4cdc2. Latest consensus state: current_term: 1 leader_uuid: "8163273395e7423e85481acbf0d4cdc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.912019 2445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:54.913031 2459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8163273395e7423e85481acbf0d4cdc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.913121 2459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:54.913132 2445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8163273395e7423e85481acbf0d4cdc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.913198 2445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:54.913415 2482 mvcc.cc:205] Tried to move back new op lower bound from 7316829613708824576 to 7316829613665898496. Current Snapshot: MvccSnapshot[applied={T|T < 7316829613708824576}]
I20260810 04:15:54.913503 2483 mvcc.cc:205] Tried to move back new op lower bound from 7316829613708824576 to 7316829613665898496. Current Snapshot: MvccSnapshot[applied={T|T < 7316829613708824576}]
I20260810 04:15:54.918653 2360 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } attempt: 3
I20260810 04:15:54.919518 2481 catalog_manager.cc:1347] Generated new cluster ID: eccfbc4871e34ab0bac893982143ee4e
I20260810 04:15:54.919564 2481 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:54.922137 2442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.898014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33748 (local address 127.10.249.188:44081)
0810 04:15:54.898063 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.898065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.905941 (+ 7876us) server_negotiation.cc:407] Connection header received
0810 04:15:54.906008 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.906009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.906018 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.906081 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.907198 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.907862 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.908891 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.909165 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.909239 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.919073 (+ 9834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.919074 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.919075 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.919081 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.920754 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.921144 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.921145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.921146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.921214 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.921434 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.921435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.921435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.921549 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.921628 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.921987 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.922050 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Aug 10 04:15:54 dist-test-slave-0kls krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
I20260810 04:15:54.928545 2362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.918879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:44081 (local address 127.0.0.1:33756)
0810 04:15:54.918942 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:54.918951 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:54.918983 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:54.919395 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:54.919396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:54.919555 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:54.919594 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.919596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.922317 (+ 2721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.922318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.922918 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:54.922921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.923475 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.923476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:54.923540 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.923897 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:54.923902 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:54.925232 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:54.927520 (+ 2288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.927521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.927521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.927736 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.927962 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:54.927962 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:54.927962 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:54.928014 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:54.928268 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:54.928269 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:54.928308 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 04:15:54.928352 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 04:15:54.928454 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 04:15:54.929003 2488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:54.919042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33756 (local address 127.10.249.188:44081)
0810 04:15:54.919186 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.919187 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.919224 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:15:54.919241 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.919242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.919252 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.919686 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.919809 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.922106 (+ 2297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.923003 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:54.923375 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:54.923450 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:54.925331 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:54.925332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:54.925332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:54.925338 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:54.927396 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.927819 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.927820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.927820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.927878 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:54.928079 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:54.928080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:54.928081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:54.928196 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:54.928723 (+ 527us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:54.928779 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 04:15:54.928877 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260810 04:15:54.930434 2360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c: Bootstrap starting.
I20260810 04:15:54.931154 2360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:54.931470 2360 log.cc:824] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:54.932799 2481 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:54.933746 2481 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:54.937373 2360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c: No bootstrap required, opened a new log
I20260810 04:15:54.939321 2360 raft_consensus.cc:348] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } }
I20260810 04:15:54.939453 2360 raft_consensus.cc:729] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dee9aee2cdc644e88fc882bde57db89c, State: Initialized, Role: FOLLOWER
I20260810 04:15:54.939540 2360 consensus_queue.cc:260] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } }
I20260810 04:15:54.939903 2332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8163273395e7423e85481acbf0d4cdc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "dee9aee2cdc644e88fc882bde57db89c"
I20260810 04:15:54.940012 2332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:54.940660 2481 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2: Generated new TSK 0
I20260810 04:15:54.940811 2332 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8163273395e7423e85481acbf0d4cdc2 in term 1.
I20260810 04:15:54.940831 2481 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:54.941221 2331 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [term 1 FOLLOWER]: Refusing update from remote peer 8163273395e7423e85481acbf0d4cdc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:54.939881 2360 sys_catalog.cc:564] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:54.941542 2486 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 04:15:54.943578 2505 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:54.943686 2505 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:54.939845 2490 sys_catalog.cc:455] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.943805 2490 sys_catalog.cc:458] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:54.943876 2490 sys_catalog.cc:455] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8163273395e7423e85481acbf0d4cdc2. Latest consensus state: current_term: 1 leader_uuid: "8163273395e7423e85481acbf0d4cdc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.943926 2490 sys_catalog.cc:458] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:54.943959 2490 sys_catalog.cc:455] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8163273395e7423e85481acbf0d4cdc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:54.944005 2490 sys_catalog.cc:458] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:54.944761 2498 mvcc.cc:205] Tried to move back new op lower bound from 7316829613830938624 to 7316829613665898496. Current Snapshot: MvccSnapshot[applied={T|T < 7316829613708824576}]
W20260810 04:15:54.968503 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:54.966956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58458 (local address 127.10.249.189:40837)
0810 04:15:54.966997 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.966999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.967870 (+ 871us) server_negotiation.cc:407] Connection header received
0810 04:15:54.967973 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.967973 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.967985 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.968033 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.968434 (+ 401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58458: BlockingRecv error: recv got EOF from 127.0.0.1:58458 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:15:54.969230 2286 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:54.967211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48742 (local address 127.10.249.190:40521)
0810 04:15:54.967247 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.967249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.968732 (+ 1483us) server_negotiation.cc:407] Connection header received
0810 04:15:54.968832 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.968833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.968843 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.968872 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.969174 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48742: BlockingRecv error: recv got EOF from 127.0.0.1:48742 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:15:54.969914 2488 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:54.967616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33768 (local address 127.10.249.188:44081)
0810 04:15:54.967653 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.967654 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.969435 (+ 1781us) server_negotiation.cc:407] Connection header received
0810 04:15:54.969523 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.969524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.969534 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.969562 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.969862 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33768: BlockingRecv error: recv got EOF from 127.0.0.1:33768 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 04:15:54.972128 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:54.971376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58472 (local address 127.10.249.189:40837)
0810 04:15:54.971411 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.971412 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.971628 (+ 216us) server_negotiation.cc:407] Connection header received
0810 04:15:54.971741 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.971742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.971757 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.971785 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.972089 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58472: BlockingRecv error: recv got EOF from 127.0.0.1:58472 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 04:15:54.975041 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:54.974331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58482 (local address 127.10.249.189:40837)
0810 04:15:54.974362 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.974363 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.974597 (+ 234us) server_negotiation.cc:407] Connection header received
0810 04:15:54.974684 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.974684 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.974693 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.974719 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.974990 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58482: BlockingRecv error: recv got EOF from 127.0.0.1:58482 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 04:15:54.978906 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:54.978112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58484 (local address 127.10.249.189:40837)
0810 04:15:54.978142 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.978144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.978382 (+ 238us) server_negotiation.cc:407] Connection header received
0810 04:15:54.978459 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.978460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.978469 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.978493 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.978870 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58484: BlockingRecv error: recv got EOF from 127.0.0.1:58484 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260810 04:15:54.984776 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:54.983982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58500 (local address 127.10.249.189:40837)
0810 04:15:54.984027 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.984029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.984295 (+ 266us) server_negotiation.cc:407] Connection header received
0810 04:15:54.984390 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.984391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.984401 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.984429 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.984737 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58500: BlockingRecv error: recv got EOF from 127.0.0.1:58500 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:15:54.994874 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:54.993968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58502 (local address 127.10.249.189:40837)
0810 04:15:54.994041 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:54.994043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:54.994333 (+ 290us) server_negotiation.cc:407] Connection header received
0810 04:15:54.994435 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:54.994435 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:54.994446 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:54.994477 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:54.994829 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58502: BlockingRecv error: recv got EOF from 127.0.0.1:58502 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 04:15:55.013026 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:55.012174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58508 (local address 127.10.249.189:40837)
0810 04:15:55.012214 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:55.012216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:55.012473 (+ 257us) server_negotiation.cc:407] Connection header received
0810 04:15:55.012573 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:55.012575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:55.012586 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:55.012627 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:55.012964 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58508: BlockingRecv error: recv got EOF from 127.0.0.1:58508 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 04:15:55.047574 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:55.046722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58518 (local address 127.10.249.189:40837)
0810 04:15:55.046764 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:55.046766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:55.047046 (+ 280us) server_negotiation.cc:407] Connection header received
0810 04:15:55.047145 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:55.047146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:55.047158 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:55.047184 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:55.047520 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58518: BlockingRecv error: recv got EOF from 127.0.0.1:58518 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:15:55.113839 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:55.113093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58520 (local address 127.10.249.189:40837)
0810 04:15:55.113161 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:55.113163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:55.113249 (+ 86us) server_negotiation.cc:407] Connection header received
0810 04:15:55.113335 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:55.113336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:55.113350 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:55.113411 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:55.113741 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58520: BlockingRecv error: recv got EOF from 127.0.0.1:58520 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 04:15:55.243782 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:55.243017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58536 (local address 127.10.249.189:40837)
0810 04:15:55.243091 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:55.243094 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:55.243201 (+ 107us) server_negotiation.cc:407] Connection header received
0810 04:15:55.243284 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:55.243285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:55.243320 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:55.243373 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:55.243732 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58536: BlockingRecv error: recv got EOF from 127.0.0.1:58536 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 04:15:55.501710 2364 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:55.501097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58550 (local address 127.10.249.189:40837)
0810 04:15:55.501167 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:55.501169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:55.501179 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:15:55.501240 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:55.501241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:55.501251 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:55.501315 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:55.501660 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58550: BlockingRecv error: recv got EOF from 127.0.0.1:58550 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:15:55.555240 2566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8163273395e7423e85481acbf0d4cdc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8163273395e7423e85481acbf0d4cdc2" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 40521 } } peers { permanent_uuid: "dee9aee2cdc644e88fc882bde57db89c" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 40837 } } peers { permanent_uuid: "c353e11598694fc9932d535605252f9e" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 44081 } } }
I20260810 04:15:55.555418 2566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8163273395e7423e85481acbf0d4cdc2 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:55.881534 2456 catalog_manager.cc:1259] Loaded cluster ID: eccfbc4871e34ab0bac893982143ee4e
I20260810 04:15:55.881608 2456 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e: loading cluster ID for follower catalog manager: success
I20260810 04:15:55.882372 2456 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e: acquiring CA information for follower catalog manager: success
I20260810 04:15:55.882611 2456 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c353e11598694fc9932d535605252f9e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:15:55.944135 2505 catalog_manager.cc:1259] Loaded cluster ID: eccfbc4871e34ab0bac893982143ee4e
I20260810 04:15:55.944214 2505 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c: loading cluster ID for follower catalog manager: success
I20260810 04:15:55.944906 2505 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c: acquiring CA information for follower catalog manager: success
I20260810 04:15:55.945140 2505 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dee9aee2cdc644e88fc882bde57db89c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:15:56.017331 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:56.014940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58552 (local address 127.10.249.189:40837)
0810 04:15:56.015065 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:56.015067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:56.015100 (+ 33us) server_negotiation.cc:407] Connection header received
0810 04:15:56.015179 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:56.015180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:56.015231 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:56.015297 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:56.015426 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.015908 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.016595 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.016782 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.016830 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:56.016961 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:56.017068 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:56.017164 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:56.017181 (+ 17us) server_negotiation.cc:299] Negotiation successful
0810 04:15:56.017202 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":80,"threads_started":1}
I20260810 04:15:56.021498 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:56.019327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33778 (local address 127.10.249.188:44081)
0810 04:15:56.019453 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:56.019455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:56.019479 (+ 24us) server_negotiation.cc:407] Connection header received
0810 04:15:56.019551 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:56.019552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:56.019583 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:56.019652 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:56.019721 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.020180 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.020832 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.021011 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.021059 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:56.021183 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:56.021275 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:56.021327 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:56.021365 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 04:15:56.021381 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260810 04:15:56.026048 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:56.023111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.10.249.189:40837)
0810 04:15:56.023152 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:56.023154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:56.023261 (+ 107us) server_negotiation.cc:407] Connection header received
0810 04:15:56.023322 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:56.023323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:56.023333 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:56.023379 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:56.023517 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.024238 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.025214 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.025525 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.025595 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:56.025771 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:56.025826 (+ 55us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:56.025853 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:56.025955 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 04:15:56.025979 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:15:56.026566 2591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:56.023065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48756 (local address 127.10.249.190:40521)
0810 04:15:56.023164 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:56.023166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:56.023300 (+ 134us) server_negotiation.cc:407] Connection header received
0810 04:15:56.023416 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:56.023417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:56.023466 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:56.023542 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:56.023732 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.024452 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.025383 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.025639 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.025735 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:56.025949 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:56.026055 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:56.026119 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:56.026445 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 04:15:56.026472 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":53,"threads_started":1}
I20260810 04:15:56.027083 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:56.023416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33782 (local address 127.10.249.188:44081)
0810 04:15:56.023453 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:56.023454 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:56.023628 (+ 174us) server_negotiation.cc:407] Connection header received
0810 04:15:56.023662 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:56.023663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:56.023672 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:56.023737 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:56.024645 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.025066 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.026141 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:56.026408 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:56.026452 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:56.026818 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:56.026848 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:56.026899 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:56.026975 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 04:15:56.026993 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:15:56.028357 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 2210
I20260810 04:15:56.035894 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 2289
I20260810 04:15:56.041827 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 2367
2026-08-10T04:15:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2794 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:15:56 dist-test-slave-0kls krb5kdc[2597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:15:56 dist-test-slave-0kls krb5kdc[2597](info): set up 2 sockets
Aug 10 04:15:56 dist-test-slave-0kls krb5kdc[2597](info): commencing operation
krb5kdc: starting...
W20260810 04:15:57.068610 11238 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/test-user.keytab.
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:15:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:15:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.249.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
Entry for principal kudu/127.10.249.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab.
I20260810 04:15:57.186582 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:34917
--webserver_interface=127.10.249.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:34425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:34917,127.10.249.189:35701,127.10.249.188:42553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:15:57.264858 2610 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:15:57.265039 2610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:57.265055 2610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:57.265074 2610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:57.266192 2610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:57.266234 2610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:57.266248 2610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:57.266261 2610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:57.266273 2610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:57.267621 2610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:34425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:34917,127.10.249.189:35701,127.10.249.188:42553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.190.keytab
--principal=kudu/127.10.249.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.190:34917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.249.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:57.267797 2610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:57.267946 2610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:57.272667 2616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:57.272662 2619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:57.272787 2610 server_base.cc:1034] running on GCE node
W20260810 04:15:57.272614 2615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:57.273108 2610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:57.273362 2610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:57.274500 2610 hybrid_clock.cc:648] HybridClock initialized: now 1786335357274488 us; error 29 us; skew 500 ppm
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:57.276836 2610 init.cc:377] Logged in from keytab as kudu/127.10.249.190@KRBTEST.COM (short username kudu)
I20260810 04:15:57.277292 2610 webserver.cc:460] Webserver started at http://127.10.249.190:41595/ using document root <none> and password file <none>
I20260810 04:15:57.277539 2610 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:57.277585 2610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:57.277743 2610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:57.278760 2610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/data/instance:
uuid: "f0736e60523b4d5babc60fa6adbde2c8"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "d66200c001d5159178c9d2349e3a5604"
server_key_iv: "a5f0bf1823024f2c87363ee87b26037f"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.279109 2610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/wal/instance:
uuid: "f0736e60523b4d5babc60fa6adbde2c8"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "d66200c001d5159178c9d2349e3a5604"
server_key_iv: "a5f0bf1823024f2c87363ee87b26037f"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.280416 2610 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:15:57.281114 2626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:57.281286 2610 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:57.281399 2610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/wal
uuid: "f0736e60523b4d5babc60fa6adbde2c8"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "d66200c001d5159178c9d2349e3a5604"
server_key_iv: "a5f0bf1823024f2c87363ee87b26037f"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.281472 2610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:57.288395 2610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:57.290042 2610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:57.290179 2610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:57.293947 2610 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.190:34917
I20260810 04:15:57.293998 2680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.190:34917 every 8 connection(s)
I20260810 04:15:57.294337 2610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/data/info.pb
I20260810 04:15:57.295163 2681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:57.296614 2681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:15:57.301149 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 2610
I20260810 04:15:57.301255 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-0/wal/instance
I20260810 04:15:57.301463 11238 external_mini_cluster.cc:1428] Setting key fc482aea2bff3fbb52e3f81eb4107c2e
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:57.305753 2684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.297266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56390 (local address 127.10.249.190:34917)
0810 04:15:57.297920 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.297924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.297949 (+ 25us) server_negotiation.cc:407] Connection header received
0810 04:15:57.298023 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.298024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.298039 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.298102 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.298593 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.299315 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.300116 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.300396 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.300467 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.302699 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.302706 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.302707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.302720 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.304196 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.304650 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.304652 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.304653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.304728 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.304972 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.304973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.304973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.305172 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.305235 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.305474 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.305604 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":621,"thread_start_us":74,"threads_started":1}
I20260810 04:15:57.305891 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.297240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34917 (local address 127.0.0.1:56390)
0810 04:15:57.297396 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.297427 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.297911 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.298131 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.298133 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.298356 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.298498 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.298502 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.299395 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.299396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.300045 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.300048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.300466 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.300467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.300521 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.300997 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.301007 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.302607 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.304280 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.304287 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.304289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.304565 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.304794 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.304795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.304796 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.304909 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.305245 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.305252 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.305326 (+ 74us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.305437 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.305700 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":90,"thread_start_us":84,"threads_started":1}
I20260810 04:15:57.306734 2681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:15:57.307072 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.306954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46378)
0810 04:15:57.307006 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.307052 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 04:15:57.307247 2628 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
I20260810 04:15:57.307718 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.307604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46382)
0810 04:15:57.307657 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.307699 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 04:15:57.307909 2681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:35701: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.10.249.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab.
Entry for principal kudu/127.10.249.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab.
I20260810 04:15:57.329391 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.189:35701
--webserver_interface=127.10.249.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab
--principal=kudu/127.10.249.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:34425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:34917,127.10.249.189:35701,127.10.249.188:42553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:15:57.357208 2681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } attempt: 1
I20260810 04:15:57.357766 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.357615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46392)
0810 04:15:57.357700 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.357734 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 04:15:57.358242 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.358149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46396)
0810 04:15:57.358197 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.358224 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:15:57.358367 2681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:35701: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
W20260810 04:15:57.412405 2688 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:15:57.412599 2688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:57.412616 2688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:57.412654 2688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:57.414579 2688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:57.414623 2688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:57.414636 2688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:57.414649 2688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:57.414688 2688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:57.416163 2688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:34425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:34917,127.10.249.189:35701,127.10.249.188:42553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.189.keytab
--principal=kudu/127.10.249.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.189:35701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.249.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:57.416417 2688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:57.416667 2688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:57.421507 2696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:57.421525 2694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:57.421523 2693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:57.421768 2688 server_base.cc:1034] running on GCE node
I20260810 04:15:57.422008 2688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:57.422286 2688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:57.423435 2688 hybrid_clock.cc:648] HybridClock initialized: now 1786335357423427 us; error 27 us; skew 500 ppm
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:57.426337 2688 init.cc:377] Logged in from keytab as kudu/127.10.249.189@KRBTEST.COM (short username kudu)
I20260810 04:15:57.426502 2681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } attempt: 2
I20260810 04:15:57.426882 2688 webserver.cc:460] Webserver started at http://127.10.249.189:44101/ using document root <none> and password file <none>
I20260810 04:15:57.426911 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.426784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46404)
0810 04:15:57.426842 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.426871 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 04:15:57.427158 2688 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:57.427228 2688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:57.427255 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.427152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46420)
0810 04:15:57.427204 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.427229 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 04:15:57.427351 2681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.189:35701: Network error: Client connection negotiation failed: client connection to 127.10.249.189:35701: connect: Connection refused (error 111)
I20260810 04:15:57.427373 2688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:57.428400 2688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/data/instance:
uuid: "df51620577da47ae8b9583d9300f33f4"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "05f6424df47b9270ddd50648465dbdf1"
server_key_iv: "4c914a1c568ba9a3dc6506dabfea9d2c"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.428689 2688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/wal/instance:
uuid: "df51620577da47ae8b9583d9300f33f4"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "05f6424df47b9270ddd50648465dbdf1"
server_key_iv: "4c914a1c568ba9a3dc6506dabfea9d2c"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.429965 2688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:15:57.430653 2703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:57.430909 2688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:15:57.430995 2688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/wal
uuid: "df51620577da47ae8b9583d9300f33f4"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "05f6424df47b9270ddd50648465dbdf1"
server_key_iv: "4c914a1c568ba9a3dc6506dabfea9d2c"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.431051 2688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:57.459559 2688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:57.461592 2688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:57.461715 2688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:57.466012 2688 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.189:35701
I20260810 04:15:57.466068 2759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.189:35701 every 8 connection(s)
I20260810 04:15:57.466451 2688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/data/info.pb
I20260810 04:15:57.467396 2760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:57.468952 2760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:57.475380 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 2688
I20260810 04:15:57.475507 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-1/wal/instance
I20260810 04:15:57.475687 11238 external_mini_cluster.cc:1428] Setting key 2fdc6867de51b85af7ff2c626c7797db
I20260810 04:15:57.478019 2684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.469720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56392 (local address 127.10.249.190:34917)
0810 04:15:57.469777 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.469779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.470122 (+ 343us) server_negotiation.cc:407] Connection header received
0810 04:15:57.470588 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.470589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.470599 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.470661 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.471274 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.471770 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.472718 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.472923 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.472974 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.475066 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.475067 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.475067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.475074 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.476564 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.477012 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.477013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.477014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.477073 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.477339 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.477340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.477340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.477453 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.477517 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.477840 (+ 323us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.477925 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:15:57.478226 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.469718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34917 (local address 127.0.0.1:56392)
0810 04:15:57.470010 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.470045 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.470508 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.470715 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.470718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.470964 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.471193 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.471197 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.471848 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.471849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.472648 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.472650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.472993 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.472994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.473120 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.473581 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.473590 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.474980 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.476673 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.476681 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.476683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.476924 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.477138 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.477139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.477139 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.477269 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.477542 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.477549 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.477696 (+ 147us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.477826 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.477983 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":118,"threads_started":1}
I20260810 04:15:57.478816 2760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.249.188@KRBTEST.COM; defaulting to no policy
I20260810 04:15:57.485916 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.479100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46428)
0810 04:15:57.479158 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.479168 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.479213 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.479485 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.479486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.479617 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.479659 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.479660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.480533 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.480534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.481029 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.481031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.481521 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.481522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.481588 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.482012 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.482016 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.483123 (+ 1107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.485003 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.485004 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.485004 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.485185 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.485398 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.485399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.485399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.485451 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.485651 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.485652 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.485685 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.485737 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.485857 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 04:15:57.486073 2764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.479198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46428 (local address 127.10.249.189:35701)
0810 04:15:57.479361 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.479365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.479380 (+ 15us) server_negotiation.cc:407] Connection header received
0810 04:15:57.479396 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.479397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.479407 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.479485 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.479732 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.480433 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.481122 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.481429 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.481521 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.483229 (+ 1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.483237 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.483237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.483244 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.484918 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.485281 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.485284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.485285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.485338 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.485488 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.485488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.485488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.485602 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.485657 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.485757 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.485910 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
I20260810 04:15:57.486683 2760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.249.188@KRBTEST.COM" created.
I20260810 04:15:57.487027 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.486901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52128)
0810 04:15:57.486948 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.486997 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 04:15:57.487164 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
I20260810 04:15:57.487581 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.487492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52138)
0810 04:15:57.487537 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.487560 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 04:15:57.487669 2760 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:42553: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.249.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab.
Entry for principal kudu/127.10.249.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab.
I20260810 04:15:57.500861 11238 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZcp64r/build/release/bin/kudu
/tmp/dist-test-taskZcp64r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.188:42553
--webserver_interface=127.10.249.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab
--principal=kudu/127.10.249.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.249.148:34425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.249.190:34917,127.10.249.189:35701,127.10.249.188:42553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:15:57.518532 2681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } attempt: 3
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
I20260810 04:15:57.525516 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.518927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46432)
0810 04:15:57.519012 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.519030 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.519095 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.519242 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.519243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.519405 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.519469 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.519471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.520148 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.520149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.520711 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.520712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.521113 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.521114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.521209 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.521691 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.521696 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.522924 (+ 1228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.524585 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.524586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.524586 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.524754 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.524958 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.524959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.524959 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.525011 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.525288 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.525289 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.525327 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.525376 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.525447 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 04:15:57.525563 2764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.519037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46432 (local address 127.10.249.189:35701)
0810 04:15:57.519107 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.519109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.519121 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:15:57.519152 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.519153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.519165 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.519237 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.519554 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.520062 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.520803 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.521024 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.521114 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.523014 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.523016 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.523017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.523025 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.524492 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.524825 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.524826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.524827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.524889 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.525067 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.525068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.525069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.525226 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.525293 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.525400 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.525478 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:15:57.526062 2681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:15:57.526417 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.526307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52148)
0810 04:15:57.526354 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.526396 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 04:15:57.526753 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.526673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52154)
0810 04:15:57.526715 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.526739 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 04:15:57.526855 2681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:42553: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
I20260810 04:15:57.536883 2760 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } attempt: 1
I20260810 04:15:57.537374 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.537235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52160)
0810 04:15:57.537303 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.537342 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 04:15:57.537722 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.537635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52170)
0810 04:15:57.537679 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.537705 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 04:15:57.537866 2760 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:42553: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
I20260810 04:15:57.557950 2681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } attempt: 1
I20260810 04:15:57.558452 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.558294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52174)
0810 04:15:57.558362 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.558407 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 04:15:57.558848 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.558751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52184)
0810 04:15:57.558800 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.558829 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:15:57.558949 2681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:42553: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
W20260810 04:15:57.583765 2768 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:15:57.583953 2768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:15:57.583968 2768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:15:57.583986 2768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:15:57.585168 2768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:15:57.585223 2768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:15:57.585238 2768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:15:57.585249 2768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:15:57.585261 2768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:15:57.586639 2768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.249.148:34425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.249.190:34917,127.10.249.189:35701,127.10.249.188:42553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/krb5kdc/kudu_127.10.249.188.keytab
--principal=kudu/127.10.249.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.249.188:42553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.249.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:15:57.586823 2768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:15:57.586982 2768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:15:57.591650 2776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:57.591665 2774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:15:57.591665 2773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:15:57.591902 2768 server_base.cc:1034] running on GCE node
I20260810 04:15:57.592124 2768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:15:57.592450 2768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:15:57.593613 2768 hybrid_clock.cc:648] HybridClock initialized: now 1786335357593602 us; error 30 us; skew 500 ppm
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:15:57.596115 2768 init.cc:377] Logged in from keytab as kudu/127.10.249.188@KRBTEST.COM (short username kudu)
I20260810 04:15:57.596596 2768 webserver.cc:460] Webserver started at http://127.10.249.188:38397/ using document root <none> and password file <none>
I20260810 04:15:57.596823 2768 fs_manager.cc:359] Metadata directory not provided
I20260810 04:15:57.596892 2768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:15:57.597030 2768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:15:57.598203 2768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/data/instance:
uuid: "a0a23f87b97444d9ba37ec3a3cffd435"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "90d6f888157b253af087fe121ecb0bcf"
server_key_iv: "2d8043885d6c8e0740026610f02aa80f"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.598579 2768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/wal/instance:
uuid: "a0a23f87b97444d9ba37ec3a3cffd435"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "90d6f888157b253af087fe121ecb0bcf"
server_key_iv: "2d8043885d6c8e0740026610f02aa80f"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.599936 2768 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:15:57.600664 2783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:15:57.600838 2768 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:15:57.600942 2768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/data,/tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/wal
uuid: "a0a23f87b97444d9ba37ec3a3cffd435"
format_stamp: "Formatted at 2026-08-10 04:15:57 on dist-test-slave-0kls"
server_key: "90d6f888157b253af087fe121ecb0bcf"
server_key_iv: "2d8043885d6c8e0740026610f02aa80f"
server_key_version: "encryptionkey@0"
I20260810 04:15:57.601027 2768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:15:57.605994 2760 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } attempt: 2
I20260810 04:15:57.606398 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.606274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52186)
0810 04:15:57.606333 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.606370 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 04:15:57.606732 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.606638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52198)
0810 04:15:57.606681 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.606705 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 04:15:57.606812 2760 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.249.188:42553: Network error: Client connection negotiation failed: client connection to 127.10.249.188:42553: connect: Connection refused (error 111)
I20260810 04:15:57.611052 2768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:15:57.612715 2768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:15:57.612866 2768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:15:57.616550 2768 rpc_server.cc:307] RPC server started. Bound to: 127.10.249.188:42553
I20260810 04:15:57.616580 2837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.249.188:42553 every 8 connection(s)
I20260810 04:15:57.616897 2768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/data/info.pb
I20260810 04:15:57.617755 2838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:15:57.619364 2838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:57.625679 11238 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZcp64r/build/release/bin/kudu as pid 2768
I20260810 04:15:57.625828 11238 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZcp64r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786335069075394-11238-0/minicluster-data/master-2/wal/instance
I20260810 04:15:57.626024 11238 external_mini_cluster.cc:1428] Setting key bafcd2a23f510f10daadd43834e121e5
I20260810 04:15:57.628043 2684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.620093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56398 (local address 127.10.249.190:34917)
0810 04:15:57.620161 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.620164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.620360 (+ 196us) server_negotiation.cc:407] Connection header received
0810 04:15:57.620829 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.620830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.620840 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.620892 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.621467 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.621993 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.622916 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.623089 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.623138 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.625023 (+ 1885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.625025 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.625025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.625032 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.626747 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.627087 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.627088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.627088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.627140 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.627415 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.627416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.627416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.627531 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.627604 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.627876 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.627955 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:15:57.628255 2840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.620070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.190:34917 (local address 127.0.0.1:56398)
0810 04:15:57.620244 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.620280 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.620749 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.620969 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.620972 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.621214 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.621399 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.621403 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.622071 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.622072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.622846 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.622848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.623157 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.623158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.623253 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.623681 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.623689 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.624942 (+ 1253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.626816 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.626821 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.626823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.627023 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.627229 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.627230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.627231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.627341 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.627597 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.627604 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.627741 (+ 137us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.627854 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.628009 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260810 04:15:57.628779 2838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
I20260810 04:15:57.634073 2681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } attempt: 2
I20260810 04:15:57.635308 2840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.629034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.189:35701 (local address 127.0.0.1:46438)
0810 04:15:57.629077 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.629086 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.629117 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.629273 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.629274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.629398 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.629439 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.629440 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.630067 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.630069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.630546 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.630547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.630943 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.630944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.631016 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.631342 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.631347 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.632473 (+ 1126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.634092 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.634093 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.634093 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.634327 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.634531 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.634532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.634532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.634706 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.634991 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.634992 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.635033 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.635103 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.635213 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 04:15:57.635412 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.626451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52206 (local address 127.10.249.188:42553)
0810 04:15:57.626642 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.626647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.626675 (+ 28us) server_negotiation.cc:407] Connection header received
0810 04:15:57.626700 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.626702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.626717 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.626809 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.627699 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.628550 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.629360 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.629643 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.629736 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.632083 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.632091 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.632092 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.632098 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.633916 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.634490 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.634493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.634493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.634645 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.634839 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.634840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.634841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.634996 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.635141 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.635225 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.635296 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":93,"threads_started":1}
I20260810 04:15:57.635656 2764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.629109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46438 (local address 127.10.249.189:35701)
0810 04:15:57.629160 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.629161 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.629168 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:15:57.629197 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.629198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.629206 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.629271 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.629522 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.629996 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.630629 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.630860 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.630933 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.632555 (+ 1622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.632557 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.632557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.632564 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.634000 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.634392 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.634394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.634394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.634459 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.634782 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.634783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.634783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.634910 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.634987 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.635493 (+ 506us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.635581 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:15:57.636659 2838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.190@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.188@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.190@KRBTEST.COM
I20260810 04:15:57.641942 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.634348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52218 (local address 127.10.249.188:42553)
0810 04:15:57.634468 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.634470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.634476 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:15:57.634490 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.634491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.634500 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.634560 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.634864 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.635519 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.636527 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.636903 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.637320 (+ 417us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.638988 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.638989 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.638989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.638995 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.640440 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.640814 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.640816 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.640816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.640875 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.641077 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.641078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.641078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.641186 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.641256 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.641419 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.641497 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":76,"threads_started":1}
I20260810 04:15:57.642091 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.634300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52218)
0810 04:15:57.634333 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.634343 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.634380 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.634574 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.634575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.634748 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.634789 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.634790 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.635608 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.635609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.636337 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.636341 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.636980 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.636981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.637033 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.637513 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.637518 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.638912 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.640545 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.640546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.640547 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.640729 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.640948 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.640949 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.640949 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.641013 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.641261 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.641262 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.641303 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.641383 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.641986 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260810 04:15:57.644112 2681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8: Bootstrap starting.
I20260810 04:15:57.644349 2840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.636918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52220)
0810 04:15:57.636972 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.636981 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.637020 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.637135 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.637136 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.637257 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.637279 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.637281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.638022 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.638023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.638504 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.638506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.638973 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.638974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.639028 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.639374 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.639378 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.641192 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.643256 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.643257 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.643258 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.643546 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.643739 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.643740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.643741 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.643810 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.644110 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.644111 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.644157 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.644198 (+ 41us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.644282 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 04:15:57.644618 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.636946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52220 (local address 127.10.249.188:42553)
0810 04:15:57.636974 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.636977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.637008 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:15:57.637070 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.637071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.637080 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.637132 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.637386 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.637933 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.638584 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.638895 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.638965 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.641281 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.641282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.641282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.641289 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.643154 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.643612 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.643613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.643614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.643664 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.643884 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.643885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.643885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.644040 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.644441 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.644482 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.644554 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260810 04:15:57.644795 2684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.636110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56400 (local address 127.10.249.190:34917)
0810 04:15:57.636159 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.636161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.636168 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:15:57.636186 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.636187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.636195 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.636249 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.636828 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.637511 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.638467 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.638754 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.638831 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.641387 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.641389 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.641389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.641395 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.643449 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.643816 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.643817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.643817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.643867 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.644096 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.644097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.644097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.644250 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.644412 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.644639 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.644719 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:15:57.644887 2681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:57.645169 2681 log.cc:824] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:57.646000 2681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8: No bootstrap required, opened a new log
I20260810 04:15:57.646775 2838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435: Bootstrap starting.
I20260810 04:15:57.647418 2838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:57.647692 2838 log.cc:824] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:57.648022 2681 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } }
I20260810 04:15:57.648176 2681 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0736e60523b4d5babc60fa6adbde2c8, State: Initialized, Role: FOLLOWER
I20260810 04:15:57.648258 2681 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } }
I20260810 04:15:57.648564 2681 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:57.648710 2838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435: No bootstrap required, opened a new log
I20260810 04:15:57.649981 2846 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.650100 2846 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: This master's current role is: FOLLOWER
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.249.189@KRBTEST.COM
W20260810 04:15:57.650668 2857 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:57.650799 2857 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:57.653141 2764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.646047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46452 (local address 127.10.249.189:35701)
0810 04:15:57.646081 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.646083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.646128 (+ 45us) server_negotiation.cc:407] Connection header received
0810 04:15:57.646212 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.646212 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.646221 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.646259 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.646668 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.647146 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.647851 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.648115 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.648209 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.650762 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.650764 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.650765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.650772 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.652047 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.652380 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.652381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.652382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.652442 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.652653 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.652654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.652654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.652778 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.652935 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.652968 (+ 33us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.653037 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:15:57.651712 2610 master_runner.cc:186] Error getting master registration for 127.10.249.189:35701: OK, instance_id { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" instance_seqno: 1786335357464773 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:15:57.654388 2610 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:15:57.654831 11238 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:15:57.655467 2838 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } }
I20260810 04:15:57.655615 2838 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a23f87b97444d9ba37ec3a3cffd435, State: Initialized, Role: FOLLOWER
I20260810 04:15:57.655645 2654 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f0736e60523b4d5babc60fa6adbde2c8"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56400
I20260810 04:15:57.655694 2838 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } }
I20260810 04:15:57.655772 2654 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 04:15:57.655821 2654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:57.655972 2838 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:57.655967 2860 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.656417 2860 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:57.656745 2654 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } }
I20260810 04:15:57.657032 2654 leader_election.cc:288] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [CANDIDATE]: Term 1 election: Requested vote from peers df51620577da47ae8b9583d9300f33f4 (127.10.249.189:35701), a0a23f87b97444d9ba37ec3a3cffd435 (127.10.249.188:42553)
I20260810 04:15:57.657389 2811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0736e60523b4d5babc60fa6adbde2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a0a23f87b97444d9ba37ec3a3cffd435"
I20260810 04:15:57.657998 2811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:15:57.659152 2811 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0736e60523b4d5babc60fa6adbde2c8 in term 1.
I20260810 04:15:57.659395 2630 leader_election.cc:302] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0a23f87b97444d9ba37ec3a3cffd435, f0736e60523b4d5babc60fa6adbde2c8; no voters:
I20260810 04:15:57.659515 2846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:15:57.659698 2846 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [term 1 LEADER]: Becoming Leader. State: Replica: f0736e60523b4d5babc60fa6adbde2c8, State: Running, Role: LEADER
I20260810 04:15:57.659803 2846 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } }
I20260810 04:15:57.660243 2876 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0736e60523b4d5babc60fa6adbde2c8. Latest consensus state: current_term: 1 leader_uuid: "f0736e60523b4d5babc60fa6adbde2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.660359 2876 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:57.660826 2878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:15:57.661077 2878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:15:57.662477 2811 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [term 1 FOLLOWER]: Refusing update from remote peer f0736e60523b4d5babc60fa6adbde2c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:57.662775 2876 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:57.661550 2768 master_runner.cc:186] Error getting master registration for 127.10.249.189:35701: OK, instance_id { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" instance_seqno: 1786335357464773 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:15:57.663625 2768 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:15:57.664640 2860 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0736e60523b4d5babc60fa6adbde2c8. Latest consensus state: current_term: 1 leader_uuid: "f0736e60523b4d5babc60fa6adbde2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.664746 2860 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:57.665436 2846 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0736e60523b4d5babc60fa6adbde2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.665531 2846 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: This master's current role is: LEADER
I20260810 04:15:57.665591 2879 mvcc.cc:205] Tried to move back new op lower bound from 7316829624983556096 to 7316829624975327232. Current Snapshot: MvccSnapshot[applied={T|T < 7316829624983556096}]
I20260810 04:15:57.666034 2860 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0736e60523b4d5babc60fa6adbde2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.666115 2860 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:57.666384 2878 catalog_manager.cc:1347] Generated new cluster ID: 5a5d401cee0847ae8e0a39ed050d0ab7
I20260810 04:15:57.666443 2878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:15:57.670506 2871 catalog_manager.cc:1259] Loaded cluster ID: 5a5d401cee0847ae8e0a39ed050d0ab7
I20260810 04:15:57.670550 2871 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435: loading cluster ID for follower catalog manager: success
W20260810 04:15:57.670635 2871 catalog_manager.cc:1576] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260810 04:15:57.670675 2871 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:57.674683 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.666191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52222 (local address 127.10.249.188:42553)
0810 04:15:57.666227 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.666229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.666593 (+ 364us) server_negotiation.cc:407] Connection header received
0810 04:15:57.666697 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.666698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.666707 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.666731 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.667390 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.668072 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.669214 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.669472 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.669507 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.671130 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.671132 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.671132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.671139 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.672853 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.673230 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.673232 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.673232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.673497 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.673713 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.673714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.673714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.674060 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.674191 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.674473 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.674585 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:15:57.677534 2684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.665997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56414 (local address 127.10.249.190:34917)
0810 04:15:57.666195 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.666197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.666470 (+ 273us) server_negotiation.cc:407] Connection header received
0810 04:15:57.666679 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.666680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.666715 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.666742 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.668038 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.668725 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.670330 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.670597 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.670640 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.673051 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.673053 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.673053 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.673060 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.675751 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.676417 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.676418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.676418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.676473 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.676785 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.676786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.676787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.676925 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.677002 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.677349 (+ 347us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.677420 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260810 04:15:57.681908 2764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.670935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46460 (local address 127.10.249.189:35701)
0810 04:15:57.670978 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.670980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.675411 (+ 4431us) server_negotiation.cc:407] Connection header received
0810 04:15:57.675496 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.675497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.675509 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.675535 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.676015 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.676703 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.677560 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.677846 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.677880 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.679210 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.679211 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.679211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.679218 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.680744 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.681119 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.681120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.681120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.681171 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.681360 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.681361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.681361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.681471 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.681535 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.681721 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.681834 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:15:57.683068 2878 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:15:57.683734 2878 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:15:57.695278 2878 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8: Generated new TSK 0
I20260810 04:15:57.695502 2878 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:15:57.697928 2760 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } attempt: 3
Aug 10 04:15:57 dist-test-slave-0kls krb5kdc[2597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786335357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.249.189@KRBTEST.COM for kudu/127.10.249.188@KRBTEST.COM
I20260810 04:15:57.707088 2762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.698203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.249.188:42553 (local address 127.0.0.1:52232)
0810 04:15:57.698298 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 04:15:57.698310 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:15:57.698349 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:15:57.698533 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:15:57.698535 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:15:57.698716 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:15:57.698776 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.698778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.699706 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.699707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.700542 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:15:57.700544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.702070 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.702071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:15:57.702131 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.702547 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:15:57.702552 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:15:57.704231 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:15:57.706036 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.706037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.706037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.706255 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.706449 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:15:57.706450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:15:57.706450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:15:57.706501 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:15:57.706808 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:15:57.706809 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:15:57.706848 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 04:15:57.706904 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:15:57.706994 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260810 04:15:57.707646 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:57.698311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52232 (local address 127.10.249.188:42553)
0810 04:15:57.698352 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.698354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.698388 (+ 34us) server_negotiation.cc:407] Connection header received
0810 04:15:57.698409 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.698410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.698419 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.698467 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.698854 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.699608 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.701571 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:57.701927 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:57.702010 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:57.704320 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:15:57.704321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:15:57.704322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:15:57.704329 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:15:57.705946 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.706332 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.706333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.706333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.706386 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:15:57.706580 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:15:57.706581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:15:57.706581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:15:57.706729 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:15:57.706784 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:57.707489 (+ 705us) server_negotiation.cc:299] Negotiation successful
0810 04:15:57.707564 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:15:57.709172 2760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4: Bootstrap starting.
I20260810 04:15:57.710198 2760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4: Neither blocks nor log segments found. Creating new log.
I20260810 04:15:57.710562 2760 log.cc:824] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4: Log is configured to *not* fsync() on all Append() calls
I20260810 04:15:57.711520 2760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4: No bootstrap required, opened a new log
I20260810 04:15:57.713527 2760 raft_consensus.cc:348] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } }
I20260810 04:15:57.713692 2760 raft_consensus.cc:729] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df51620577da47ae8b9583d9300f33f4, State: Initialized, Role: FOLLOWER
I20260810 04:15:57.713770 2760 consensus_queue.cc:260] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } }
I20260810 04:15:57.714133 2760 sys_catalog.cc:564] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:15:57.714098 2891 sys_catalog.cc:455] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.714290 2891 sys_catalog.cc:458] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:57.715415 2733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0736e60523b4d5babc60fa6adbde2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "df51620577da47ae8b9583d9300f33f4"
I20260810 04:15:57.715525 2733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [term 0 FOLLOWER]: Advancing to term 1
W20260810 04:15:57.715914 2902 catalog_manager.cc:1558] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:15:57.716009 2902 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:15:57.716918 2733 raft_consensus.cc:2454] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0736e60523b4d5babc60fa6adbde2c8 in term 1.
I20260810 04:15:57.717119 2732 raft_consensus.cc:1261] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [term 1 FOLLOWER]: Refusing update from remote peer f0736e60523b4d5babc60fa6adbde2c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:15:57.717481 2846 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:15:57.718976 2891 sys_catalog.cc:455] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0736e60523b4d5babc60fa6adbde2c8. Latest consensus state: current_term: 1 leader_uuid: "f0736e60523b4d5babc60fa6adbde2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.719060 2891 sys_catalog.cc:458] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:57.719094 2891 sys_catalog.cc:455] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f0736e60523b4d5babc60fa6adbde2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:57.719131 2891 sys_catalog.cc:458] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:15:57.725632 2904 mvcc.cc:205] Tried to move back new op lower bound from 7316829625086103552 to 7316829624975327232. Current Snapshot: MvccSnapshot[applied={T|T < 7316829624983556096}]
W20260810 04:15:57.736400 2684 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.734647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56420 (local address 127.10.249.190:34917)
0810 04:15:57.734693 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.734696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.735713 (+ 1017us) server_negotiation.cc:407] Connection header received
0810 04:15:57.735839 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.735840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.735855 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.735889 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.736331 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56420: BlockingRecv error: recv got EOF from 127.0.0.1:56420 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260810 04:15:57.737108 2842 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.735005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52248 (local address 127.10.249.188:42553)
0810 04:15:57.735050 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.735052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.736644 (+ 1592us) server_negotiation.cc:407] Connection header received
0810 04:15:57.736735 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.736736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.736745 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.736771 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.737053 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52248: BlockingRecv error: recv got EOF from 127.0.0.1:52248 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:15:57.737684 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.735470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46464 (local address 127.10.249.189:35701)
0810 04:15:57.735512 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.735514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.737299 (+ 1785us) server_negotiation.cc:407] Connection header received
0810 04:15:57.737360 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.737362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.737373 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.737415 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.737635 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46464: BlockingRecv error: recv got EOF from 127.0.0.1:46464 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 04:15:57.739717 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.738981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46476 (local address 127.10.249.189:35701)
0810 04:15:57.739020 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.739022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.739206 (+ 184us) server_negotiation.cc:407] Connection header received
0810 04:15:57.739302 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.739303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.739318 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.739345 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.739679 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46476: BlockingRecv error: recv got EOF from 127.0.0.1:46476 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:15:57.742678 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.741963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46488 (local address 127.10.249.189:35701)
0810 04:15:57.741993 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.741995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.742227 (+ 232us) server_negotiation.cc:407] Connection header received
0810 04:15:57.742315 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.742316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.742325 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.742351 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.742638 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46488: BlockingRecv error: recv got EOF from 127.0.0.1:46488 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260810 04:15:57.746380 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.745659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46490 (local address 127.10.249.189:35701)
0810 04:15:57.745715 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.745717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.745951 (+ 234us) server_negotiation.cc:407] Connection header received
0810 04:15:57.746049 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.746050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.746059 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.746083 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.746344 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46490: BlockingRecv error: recv got EOF from 127.0.0.1:46490 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260810 04:15:57.752079 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.751374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46506 (local address 127.10.249.189:35701)
0810 04:15:57.751405 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.751407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.751613 (+ 206us) server_negotiation.cc:407] Connection header received
0810 04:15:57.751708 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.751709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.751718 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.751745 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.752042 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46506: BlockingRecv error: recv got EOF from 127.0.0.1:46506 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 04:15:57.762006 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.761104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46514 (local address 127.10.249.189:35701)
0810 04:15:57.761136 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.761137 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.761340 (+ 203us) server_negotiation.cc:407] Connection header received
0810 04:15:57.761432 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.761433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.761442 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.761468 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.761770 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46514: BlockingRecv error: recv got EOF from 127.0.0.1:46514 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 04:15:57.779778 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.779035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46524 (local address 127.10.249.189:35701)
0810 04:15:57.779064 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.779066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.779291 (+ 225us) server_negotiation.cc:407] Connection header received
0810 04:15:57.779377 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.779378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.779387 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.779413 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.779717 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46524: BlockingRecv error: recv got EOF from 127.0.0.1:46524 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260810 04:15:57.814015 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.813083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46532 (local address 127.10.249.189:35701)
0810 04:15:57.813128 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.813131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.813397 (+ 266us) server_negotiation.cc:407] Connection header received
0810 04:15:57.813497 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.813499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.813510 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.813539 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.813960 (+ 421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46532: BlockingRecv error: recv got EOF from 127.0.0.1:46532 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:15:57.879937 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:57.879328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46542 (local address 127.10.249.189:35701)
0810 04:15:57.879391 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:57.879393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:57.879456 (+ 63us) server_negotiation.cc:407] Connection header received
0810 04:15:57.879505 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:57.879506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:57.879516 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:57.879561 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:57.879888 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46542: BlockingRecv error: recv got EOF from 127.0.0.1:46542 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 04:15:58.010536 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:58.009614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46558 (local address 127.10.249.189:35701)
0810 04:15:58.009663 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:58.009665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:58.009837 (+ 172us) server_negotiation.cc:407] Connection header received
0810 04:15:58.009963 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:58.009965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:58.009980 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:58.010010 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:58.010470 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46558: BlockingRecv error: recv got EOF from 127.0.0.1:46558 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:15:58.133090 2846 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f0736e60523b4d5babc60fa6adbde2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0736e60523b4d5babc60fa6adbde2c8" member_type: VOTER last_known_addr { host: "127.10.249.190" port: 34917 } } peers { permanent_uuid: "df51620577da47ae8b9583d9300f33f4" member_type: VOTER last_known_addr { host: "127.10.249.189" port: 35701 } } peers { permanent_uuid: "a0a23f87b97444d9ba37ec3a3cffd435" member_type: VOTER last_known_addr { host: "127.10.249.188" port: 42553 } } }
I20260810 04:15:58.133281 2846 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0736e60523b4d5babc60fa6adbde2c8 [sys.catalog]: This master's current role is: LEADER
W20260810 04:15:58.268194 2764 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:15:58.267628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46572 (local address 127.10.249.189:35701)
0810 04:15:58.267688 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:58.267690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:58.267700 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:15:58.267733 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:58.267733 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:58.267742 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:58.267791 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:15:58.268133 (+ 342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46572: BlockingRecv error: recv got EOF from 127.0.0.1:46572 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:15:58.671792 2871 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435: acquiring CA information for follower catalog manager: success
I20260810 04:15:58.672113 2871 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a0a23f87b97444d9ba37ec3a3cffd435: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:15:58.716463 2902 catalog_manager.cc:1259] Loaded cluster ID: 5a5d401cee0847ae8e0a39ed050d0ab7
I20260810 04:15:58.716598 2902 catalog_manager.cc:1552] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4: loading cluster ID for follower catalog manager: success
I20260810 04:15:58.717414 2902 catalog_manager.cc:1574] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4: acquiring CA information for follower catalog manager: success
I20260810 04:15:58.717741 2902 catalog_manager.cc:1602] T 00000000000000000000000000000000 P df51620577da47ae8b9583d9300f33f4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:15:58.783803 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:58.781440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46578 (local address 127.10.249.189:35701)
0810 04:15:58.781554 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:58.781556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:58.781567 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:15:58.781649 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:58.781649 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:58.781697 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:58.781773 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:58.781995 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.782445 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.783091 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.783279 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.783326 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:58.783478 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:58.783593 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:58.783650 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:58.783678 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 04:15:58.783696 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":68,"threads_started":1}
I20260810 04:15:58.787441 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:58.785536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52252 (local address 127.10.249.188:42553)
0810 04:15:58.785664 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:58.785666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:58.785681 (+ 15us) server_negotiation.cc:407] Connection header received
0810 04:15:58.785724 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:58.785725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:58.785757 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:58.785862 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:58.785938 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.786348 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.786910 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.787069 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.787111 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:58.787215 (+ 104us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:58.787294 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:58.787342 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:58.787371 (+ 29us) server_negotiation.cc:299] Negotiation successful
0810 04:15:58.787388 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":86,"threads_started":1}
I20260810 04:15:58.791985 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:58.789197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52254 (local address 127.10.249.188:42553)
0810 04:15:58.789230 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:58.789231 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:58.789351 (+ 120us) server_negotiation.cc:407] Connection header received
0810 04:15:58.789441 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:58.789441 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:58.789449 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:58.789487 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:58.789587 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.790133 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.791242 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.791450 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.791480 (+ 30us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:58.791718 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:58.791748 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:58.791796 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:58.791880 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 04:15:58.791901 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:15:58.792104 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:58.788989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46582 (local address 127.10.249.189:35701)
0810 04:15:58.789039 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:58.789040 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:58.789242 (+ 202us) server_negotiation.cc:407] Connection header received
0810 04:15:58.789437 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:58.789439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:58.789448 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:58.789497 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:58.789731 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.790411 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.791173 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.791454 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.791516 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:58.791825 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:58.791859 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:58.791908 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:58.792009 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 04:15:58.792035 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:15:58.792570 2989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:15:58.788954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56422 (local address 127.10.249.190:34917)
0810 04:15:58.789094 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 04:15:58.789095 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:15:58.789104 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:15:58.789217 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:15:58.789218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:15:58.789268 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:15:58.789332 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:15:58.789503 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.790275 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.791237 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:15:58.791560 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:15:58.791618 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:15:58.792246 (+ 628us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:15:58.792335 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:15:58.792387 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 04:15:58.792472 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 04:15:58.792495 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":59,"threads_started":1}
I20260810 04:15:58.794020 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 2610
I20260810 04:15:58.803409 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 2688
I20260810 04:15:58.809113 11238 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZcp64r/build/release/bin/kudu with pid 2768
2026-08-10T04:15:58Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2767 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5561 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (289742 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS